-- Logs begin at Thu 2022-06-16 20:03:24 UTC, end at Thu 2022-06-16 21:33:18 UTC. -- Jun 16 20:58:27.412387 dv-cinder-819149-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 20:58:27.421434 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 20:58:27 2022] *** Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: nodename: dv-cinder-819149-6-iscsi Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: machine: x86_64 Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: clock source: unix Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: pcre jit disabled Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: detected number of CPU cores: 4 Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: current working directory: / Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: detected binary path: /usr/bin/uwsgi-core Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: your processes number limit is 47680 Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: your memory page size is 4096 bytes Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: detected max file descriptor number: 2048 Jun 16 20:58:27.424094 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: lock engine: pthread robust mutexes Jun 16 20:58:27.424861 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: thunder lock: enabled Jun 16 20:58:27.424861 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 20:58:27.424861 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 20:58:27.473953 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: Python main interpreter initialized at 0x556bc8d049c0 Jun 16 20:58:27.473953 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: python threads support enabled Jun 16 20:58:27.473953 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: your server socket listen backlog is limited to 100 connections Jun 16 20:58:27.473953 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: your mercy for graceful operations on workers is 90 seconds Jun 16 20:58:27.474338 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 20:58:27.474421 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: *** Operational MODE: preforking *** Jun 16 20:58:27.474673 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: *** uWSGI is running in multiple interpreter mode *** Jun 16 20:58:27.474673 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: spawned uWSGI master process (pid: 80411) Jun 16 20:58:27.474889 dv-cinder-819149-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 16 20:58:27.479050 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: spawned uWSGI worker 1 (pid: 80415, cores: 1) Jun 16 20:58:27.479050 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: spawned uWSGI worker 2 (pid: 80416, cores: 1) Jun 16 20:58:27.479050 dv-cinder-819149-6-iscsi devstack@keystone.service[80411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 20:58:33.076847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:58:33.076847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: from cryptography.utils import int_from_bytes Jun 16 20:58:33.077631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:58:33.077631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: from cryptography.utils import int_from_bytes Jun 16 20:58:33.078040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:58:33.078040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: from cryptography.utils import int_from_bytes Jun 16 20:58:33.078149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:58:33.078149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: from cryptography.utils import int_from_bytes Jun 16 20:58:33.127476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 20:58:33.127647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 20:58:33.127844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] command line args: [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 20:58:33.127944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 20:58:33.128099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 20:58:33.128213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 20:58:33.128296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ================================================================================ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 20:58:33.128367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] command line args: [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 20:58:33.128548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] admin_token = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.128633 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 20:58:33.128739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ================================================================================ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 20:58:33.128828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config_dir = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.128969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] admin_token = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] config_source = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_dir = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] debug = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] config_source = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] debug = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.129930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.130999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_config_append = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_config_append = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_dir = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_dir = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.131970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.132972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.133889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.134018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.134145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.134259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.134372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.222009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.222311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.222629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.222739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.222967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.223171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.223281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.223369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] publish_errors = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.223615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.223802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.223880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] publish_errors = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] standard_threads = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.224967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225515 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] standard_threads = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_journal = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_json = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.225936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_stderr = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] use_syslog = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_journal = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_json = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.226724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_stderr = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] use_syslog = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.226911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.227075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:58:33.227159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.227341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.227418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.227588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.227663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.227854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.227931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.228960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.229939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.230919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.231096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.231179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.231384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.231486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.231650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.231861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.231975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.232971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.233884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.234918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.235984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.236096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.236223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.236338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.236449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.236683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.236808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.236921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.237933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.238902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239097 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239189 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.239899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.240911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241715 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.241952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242300 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242752 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.242984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.243919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.244993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.245918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.246037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.246150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.246262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.246389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.246510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.246624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.246736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.247343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.247503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.247628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.247743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.247856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.248966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.249894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.250933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.251949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.external = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.external = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.252945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.password = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] auth.token = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.password = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.253894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] auth.token = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.254940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.255987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.256105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.256278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.256394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.256518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.256655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.256805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.256927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257515 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.257969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.258902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.259935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.260887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.261940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.262053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.262165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.262355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.262555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.263205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.263354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.263471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.263595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.263718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.263833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.263833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.264995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.265914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.266946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.267990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.268964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.269895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.270340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.270455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.270575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.270696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.270810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.270933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.271982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.272936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273397 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.273894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.274918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.275957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.276937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.277871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.278259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.278388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.278503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.278616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.278729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.278853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.278968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.279996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.280975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.281893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.282921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.283958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.284898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.285885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.286920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.287971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.288943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.289983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.290911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.291939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.292897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.293926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.294972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.295984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.296944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.297977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.298997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.299939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.300878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.301492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.301612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.301726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.301849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.301964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.302997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.303111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.303232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.303347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 20:58:33.303463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.303463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:58:33.303463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 20:58:33.332359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.332523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.332604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.332708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.332792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.332938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.342357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.342451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.371149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.371381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.371748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.372054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.425095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.425546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.475082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.475319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.475431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.475610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.542199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.542419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.542513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.542645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.542732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.542868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.542951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.543089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.543171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.543305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.543387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.543520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.566969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.567940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.568077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.568158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.568328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.568423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.579474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.579813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.592160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.592388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.592618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.592776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.592879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.592976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80416) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.593849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80415) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:58:33.613390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.613610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:58:33.613707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.613869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:58:33.613984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.614141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:58:33.614225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.614396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:58:33.614477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.614662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.614745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.614919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.615000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.615174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.615263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.615428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.626649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.626926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.627009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.627195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.627294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.627475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.627559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.627789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.635729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.636020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.639237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.639368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.639521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.639648 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.639805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.639929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.640088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.640235 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.640398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.640522 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.640663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.640782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.640938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.641051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.641215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.641305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.641485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.641566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.641756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.641837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.642022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.642105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.668573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.669336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.670723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.671004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.671089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.671299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.676279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.676581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.676663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.676951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.677034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.677246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.684957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.685139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.685293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.685433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.689651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.689923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.690008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.690203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.690289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.690484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.690567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.690757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.690840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.691032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.691114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.691300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.691381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.691570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.691659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.691843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.710585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.710686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.710865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.710965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.715437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.715522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.719264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.719362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.719666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.719751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.724965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.725056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.728652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.728738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.732871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.732986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.733167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.733251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.733451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.733549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.733731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.733811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.734008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.734087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.734290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.734377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.754734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.754936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.755019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.755221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.755304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.755492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.755571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.755756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.764232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.764501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.765954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.766211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.766294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.766491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.769427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.769725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.769807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.770005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.770086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.770298 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.770380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.770577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.770661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.770849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.784061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.784364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.784649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.784731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.784932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.785023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.785274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.785354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.785556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.785638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.785865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.785947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.786209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.786490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.804270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.804945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.807527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.808219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.811453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.812220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.813220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.813964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.814876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.815158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.815444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.815617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.815895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.816196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.822735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.823463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.824356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.825176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.827724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.828014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.828433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.828631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.828713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.828923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.829320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.829601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.838393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.838689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.838783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.838969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.839051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.839296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.847385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80415) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.847559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80416) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:58:33.847645 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.847842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.847924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.848125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.848221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.848422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.848504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.848713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.848821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849370 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.849993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.850192 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.850271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.850461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.850541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.850728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.850806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.850990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80415) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.851069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.851248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80416) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:58:33.889973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bc8d049c0 pid: 80415 (default app) Jun 16 20:58:33.890074 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556bc8d049c0 pid: 80416 (default app) Jun 16 20:58:33.893393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209acaa-9980-4257-9d04-d103583d252e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:33.893689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209acaa-9980-4257-9d04-d103583d252e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:33.893972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209acaa-9980-4257-9d04-d103583d252e None None] PATH_INFO: `/v3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:33.898209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Jun 16 20:58:33 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:41.656614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1591ee-3d96-40e4-8d66-256b5294406e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:41.657125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1591ee-3d96-40e4-8d66-256b5294406e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:41.657224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1591ee-3d96-40e4-8d66-256b5294406e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:41.661499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:41.666572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:41.667008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:41.667100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:41.736696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: INFO dbcounter [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] Registered counter for database keystone Jun 16 20:58:41.757772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG oslo_db.sqlalchemy.engines [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 20:58:41.764530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writer thread running {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 20:58:41.938654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG passlib.handlers.bcrypt [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80415) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 20:58:41.938986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG passlib.handlers.bcrypt [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80415) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 20:58:41.992720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:41.994301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:42.118571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 20:58:42.274258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1591ee-3d96-40e4-8d66-256b5294406e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:42.346316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: INFO dbcounter [None req-2d1591ee-3d96-40e4-8d66-256b5294406e None None] Registered counter for database keystone Jun 16 20:58:42.366061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG oslo_db.sqlalchemy.engines [None req-2d1591ee-3d96-40e4-8d66-256b5294406e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 20:58:42.372348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writer thread running {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 20:58:42.497894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1591ee-3d96-40e4-8d66-256b5294406e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:42.502299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f153612-8260-4b46-81e7-dfd9b39932da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:42.502966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153612-8260-4b46-81e7-dfd9b39932da admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:42.503255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153612-8260-4b46-81e7-dfd9b39932da admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:42.503539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f153612-8260-4b46-81e7-dfd9b39932da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:42.511894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f153612-8260-4b46-81e7-dfd9b39932da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:42.564117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4f153612-8260-4b46-81e7-dfd9b39932da admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 20:58:42.564491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f153612-8260-4b46-81e7-dfd9b39932da admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:42.574349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Jun 16 20:58:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:58:42.580889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:42.595937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a523c9c-1d58-4d95-b7ad-ba68f51fa9c9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:42.600740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e971e7-636f-42df-be7c-7cc5671b2111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:42.601864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e971e7-636f-42df-be7c-7cc5671b2111 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:42.602149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e971e7-636f-42df-be7c-7cc5671b2111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:42.602434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e971e7-636f-42df-be7c-7cc5671b2111 admin admin] PATH_INFO: `/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:42.603942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e971e7-636f-42df-be7c-7cc5671b2111 admin admin] RBAC: Authorizing `identity:get_project(project_id=c0cca612cc8a4e54bb60862d1d2ad94b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:42.654701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING keystone.common.rbac_enforcer.enforcer [None req-41e971e7-636f-42df-be7c-7cc5671b2111 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 20:58:42.655038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e971e7-636f-42df-be7c-7cc5671b2111 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:42.659729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Jun 16 20:58:42 2022] GET /identity/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:44.792963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319cfe-de58-4267-8ec6-85206197fd55 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:44.793470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319cfe-de58-4267-8ec6-85206197fd55 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:44.794230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec319cfe-de58-4267-8ec6-85206197fd55 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:44.798668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:44.803941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47245053-11e8-4a86-82bf-033e92704a0c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:44.804397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47245053-11e8-4a86-82bf-033e92704a0c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:44.804563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47245053-11e8-4a86-82bf-033e92704a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:44.823153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-47245053-11e8-4a86-82bf-033e92704a0c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:44.825231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-47245053-11e8-4a86-82bf-033e92704a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:44.833200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 20:58:44.856485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec319cfe-de58-4267-8ec6-85206197fd55 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:44.868382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec319cfe-de58-4267-8ec6-85206197fd55 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:44.872796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff91a59-bf22-4a02-9c80-157e4165f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:44.873430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91a59-bf22-4a02-9c80-157e4165f0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:44.873719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91a59-bf22-4a02-9c80-157e4165f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:44.873999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff91a59-bf22-4a02-9c80-157e4165f0d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:44.881703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff91a59-bf22-4a02-9c80-157e4165f0d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:44.883483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff91a59-bf22-4a02-9c80-157e4165f0d4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:44.892705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Jun 16 20:58:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:58:44.897828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47245053-11e8-4a86-82bf-033e92704a0c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:44.907884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47245053-11e8-4a86-82bf-033e92704a0c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:44.912318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fd854-7912-4c0f-a320-ef77793f790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:44.913175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fd854-7912-4c0f-a320-ef77793f790f admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:44.913458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fd854-7912-4c0f-a320-ef77793f790f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:44.913732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fd854-7912-4c0f-a320-ef77793f790f admin admin] PATH_INFO: `/v3/users/80358824790f4a5498dad87c4c82e1b6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:44.915114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fd854-7912-4c0f-a320-ef77793f790f admin admin] RBAC: Authorizing `identity:get_user(user_id=80358824790f4a5498dad87c4c82e1b6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:44.916982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fd854-7912-4c0f-a320-ef77793f790f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:44.918930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Jun 16 20:58:44 2022] GET /identity/v3/users/80358824790f4a5498dad87c4c82e1b6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:47.081959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e789d-9499-432c-aa3b-5888c87418e4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.082504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e789d-9499-432c-aa3b-5888c87418e4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.082504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e789d-9499-432c-aa3b-5888c87418e4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.083865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:58:47.088963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26a37a-977d-4f95-94aa-3014ba9cc3c8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.089405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26a37a-977d-4f95-94aa-3014ba9cc3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.089534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26a37a-977d-4f95-94aa-3014ba9cc3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.108294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9b26a37a-977d-4f95-94aa-3014ba9cc3c8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:47.109501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9b26a37a-977d-4f95-94aa-3014ba9cc3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:47.119562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595132e-f733-4c58-9e42-1a7474e91e54 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.119854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595132e-f733-4c58-9e42-1a7474e91e54 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.120131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595132e-f733-4c58-9e42-1a7474e91e54 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.121530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:58:47.127234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38391-e176-401a-88ef-859720247203 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.127530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38391-e176-401a-88ef-859720247203 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.127811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc38391-e176-401a-88ef-859720247203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.168039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG passlib.handlers.bcrypt [None req-edc38391-e176-401a-88ef-859720247203 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80416) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 20:58:47.169095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG passlib.handlers.bcrypt [None req-edc38391-e176-401a-88ef-859720247203 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80416) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 20:58:47.194206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:58:47.214931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-edc38391-e176-401a-88ef-859720247203 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:47.216706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-edc38391-e176-401a-88ef-859720247203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:47.217515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26a37a-977d-4f95-94aa-3014ba9cc3c8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.241035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:47.319452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:58:47.319727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26a37a-977d-4f95-94aa-3014ba9cc3c8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.341871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc38391-e176-401a-88ef-859720247203 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.352888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.353696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.353981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.354262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.366271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:58:47.378259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:58:47.379195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:58:47.380023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:58:47.385133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.441916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc38391-e176-401a-88ef-859720247203 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.444140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:47.467844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:47.484418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.485315 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.485601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.485877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.486361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad326b9e-42c2-4b8c-a694-f752a08628ac None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.520882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.521552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.521837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.522118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.522875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:58:47.523185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:47.524639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:47.536767 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:47.542098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.553641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:47.555158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:47.641216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751dad5-b101-465e-b085-c37d25aad882 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.656752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:58:47.662467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.665115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:47.677809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.678700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.678969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.679244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] PATH_INFO: `/v3/users/80358824790f4a5498dad87c4c82e1b6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.680465 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] RBAC: Authorizing `identity:get_user(user_id=80358824790f4a5498dad87c4c82e1b6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:47.681932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:47.683751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/users/80358824790f4a5498dad87c4c82e1b6 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:47.689447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.703704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:47.764265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebd803-4499-48eb-b536-251382dfc6f7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.794775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a3746-b812-47e0-82b4-c28fb8613b9e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.800968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.801774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.802079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.802343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.820797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:47.822259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:47.828105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.828934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.829229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.829506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.830695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:47.832125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:47.833768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:47.839399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:58:47.844360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:58:47.845318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:58:47.846155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:58:47.846155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:58:47.846155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:58:47.846155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:58:47.846155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:58:47.851270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:47.908617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:47.921833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:47.940752 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcef138-787d-4dc9-bc73-7650cc593996 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.953222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cbf0e-a815-4919-8cfc-62f1f38ebc15 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:47.974503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fc7d0-518c-4e47-9f3d-85497c64e04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.975158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc7d0-518c-4e47-9f3d-85497c64e04b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.975455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc7d0-518c-4e47-9f3d-85497c64e04b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.975711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc7d0-518c-4e47-9f3d-85497c64e04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.976572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fc7d0-518c-4e47-9f3d-85497c64e04b None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.domain.id=default, user.id=80358824790f4a5498dad87c4c82e1b6) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:58:47.976878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fc7d0-518c-4e47-9f3d-85497c64e04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:47.978319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fc7d0-518c-4e47-9f3d-85497c64e04b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:47.985059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/role_assignments?user.id=80358824790f4a5498dad87c4c82e1b6&scope.domain.id=default&role.id=b7564b3ff8064aa09459135574f0a043 => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:47.986727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a6e06-bf43-457d-ba1e-9334112be03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:47.987390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a6e06-bf43-457d-ba1e-9334112be03f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:47.987681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a6e06-bf43-457d-ba1e-9334112be03f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:47.987971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a6e06-bf43-457d-ba1e-9334112be03f None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:47.988746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a6e06-bf43-457d-ba1e-9334112be03f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:58:47.989062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a6e06-bf43-457d-ba1e-9334112be03f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:47.990486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a6e06-bf43-457d-ba1e-9334112be03f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:48.010480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:50.339107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00c3b0-29ff-46a0-8728-c957e0aac7ea None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:50.340114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00c3b0-29ff-46a0-8728-c957e0aac7ea None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:50.341297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00c3b0-29ff-46a0-8728-c957e0aac7ea None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:50.342894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:50.348852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2616-5752-4ede-b7bf-7c3df3a02f75 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:50.349295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2616-5752-4ede-b7bf-7c3df3a02f75 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:50.349496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee2616-5752-4ede-b7bf-7c3df3a02f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:50.373522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a4ee2616-5752-4ede-b7bf-7c3df3a02f75 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:50.374710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a4ee2616-5752-4ede-b7bf-7c3df3a02f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:50.471527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:58:50.509961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00c3b0-29ff-46a0-8728-c957e0aac7ea None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:50.595164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1815-0555-45fd-947c-f935afa441e5 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:50.595464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1815-0555-45fd-947c-f935afa441e5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:50.595643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b1815-0555-45fd-947c-f935afa441e5 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:50.597306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:58:50.603476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a839-482c-4623-a35e-fc64f4d3c72a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:50.603762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a839-482c-4623-a35e-fc64f4d3c72a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:50.604041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a839-482c-4623-a35e-fc64f4d3c72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:50.641206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8536a839-482c-4623-a35e-fc64f4d3c72a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:50.642761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8536a839-482c-4623-a35e-fc64f4d3c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:50.708886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00c3b0-29ff-46a0-8728-c957e0aac7ea None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:50.745777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:50.777255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:50.778659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:50.778943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:50.779242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:50.801626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 13/25] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:58:50.803629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:58:50.811823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:58:50.812674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:58:50.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:58:50.821971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 13/26] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:58:50.828616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536a839-482c-4623-a35e-fc64f4d3c72a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:50.852458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:50.859047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:50.986462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aaa6cb-213a-47b8-8982-9a67bfc41c8e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.017868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536a839-482c-4623-a35e-fc64f4d3c72a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.024605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.025766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.026251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.026726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.038527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.040483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:58:51.060944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:58:51.061786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:58:51.062595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:58:51.062595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:58:51.062595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:58:51.062595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:58:51.065175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 14/27] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:58:51.071155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:51.093483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.094435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.094866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.095295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.096294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:58:51.096779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.098607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.130726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 14/28] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:58:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:51.136192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:51.168491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:51.210334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:51.229183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb6573-427b-4d9b-b1ba-9e9182849ff3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.266745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df0c36-51e2-4b92-8e19-b5ef620343c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.267657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0c36-51e2-4b92-8e19-b5ef620343c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.268088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0c36-51e2-4b92-8e19-b5ef620343c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.268558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df0c36-51e2-4b92-8e19-b5ef620343c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.269443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0c36-51e2-4b92-8e19-b5ef620343c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:58:51.269895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0c36-51e2-4b92-8e19-b5ef620343c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.271535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df0c36-51e2-4b92-8e19-b5ef620343c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.291754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 15/29] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:51.293590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f4601-c1f1-4705-9f0c-9a511bb00ad1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.294210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f4601-c1f1-4705-9f0c-9a511bb00ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.294693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355f4601-c1f1-4705-9f0c-9a511bb00ad1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.296371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:51.301254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f4601-c1f1-4705-9f0c-9a511bb00ad1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:51.302224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731697c5-41e3-4fff-bcd3-dda5be56abaa None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.368852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd7499-0449-402a-9977-df18989f964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.369747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7499-0449-402a-9977-df18989f964d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.370035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7499-0449-402a-9977-df18989f964d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.370313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd7499-0449-402a-9977-df18989f964d None admin] PATH_INFO: `/v3/users/80358824790f4a5498dad87c4c82e1b6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.374963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd7499-0449-402a-9977-df18989f964d None admin] RBAC: Authorizing `identity:get_user(user_id=80358824790f4a5498dad87c4c82e1b6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.376470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd7499-0449-402a-9977-df18989f964d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.381690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 15/31] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:58:51 2022] GET /identity/v3/users/80358824790f4a5498dad87c4c82e1b6 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:51.383072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1866e6c-e083-42fc-a2a4-d9614348a70c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.383404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1866e6c-e083-42fc-a2a4-d9614348a70c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.383757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1866e6c-e083-42fc-a2a4-d9614348a70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.400884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a1866e6c-e083-42fc-a2a4-d9614348a70c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:51.402162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a1866e6c-e083-42fc-a2a4-d9614348a70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:51.443243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355f4601-c1f1-4705-9f0c-9a511bb00ad1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.460843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:51.474793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 16/32] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:58:51.476319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25064-95e1-470b-9b5b-b76ba8823a7c None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.476811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25064-95e1-470b-9b5b-b76ba8823a7c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.477166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f25064-95e1-470b-9b5b-b76ba8823a7c None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.478487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 17/33] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:51.480509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.481253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.481548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.481922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.482785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.483434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25064-95e1-470b-9b5b-b76ba8823a7c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:51.484722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.522737 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:51.603895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f25064-95e1-470b-9b5b-b76ba8823a7c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.645159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45b14-2dd1-41db-af7f-891507e8dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.646400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45b14-2dd1-41db-af7f-891507e8dace None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.646914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45b14-2dd1-41db-af7f-891507e8dace None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.647364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45b14-2dd1-41db-af7f-891507e8dace None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.648971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a45b14-2dd1-41db-af7f-891507e8dace None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.650896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a45b14-2dd1-41db-af7f-891507e8dace None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.653208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 18/34] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:51.654901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f06d04-050c-4ed3-967f-7c4c71c7b345 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.655373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f06d04-050c-4ed3-967f-7c4c71c7b345 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.655821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f06d04-050c-4ed3-967f-7c4c71c7b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.675181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-00f06d04-050c-4ed3-967f-7c4c71c7b345 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:51.676861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-00f06d04-050c-4ed3-967f-7c4c71c7b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:51.759370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 19/35] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:58:51.768988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f06d04-050c-4ed3-967f-7c4c71c7b345 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:51.775406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 17/36] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 20:58:51 2022] POST /identity/v3/projects => generated 301 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:58:51.776799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:51.825276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:51.904194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f06d04-050c-4ed3-967f-7c4c71c7b345 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.906667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291e3c5-b727-42d5-9964-b999ca292453 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:51.943514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.944156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.944476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.944754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.945511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.946912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.949943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e93fb-2041-494a-a897-dc2aee7265cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:51.951249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e93fb-2041-494a-a897-dc2aee7265cb None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.951734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e93fb-2041-494a-a897-dc2aee7265cb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.952416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e93fb-2041-494a-a897-dc2aee7265cb None admin] PATH_INFO: `/v3/domains/default/users/80358824790f4a5498dad87c4c82e1b6/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.955424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e93fb-2041-494a-a897-dc2aee7265cb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=80358824790f4a5498dad87c4c82e1b6, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:51.957682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e93fb-2041-494a-a897-dc2aee7265cb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:51.977299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 18/37] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Jun 16 20:58:51 2022] PUT /identity/v3/domains/default/users/80358824790f4a5498dad87c4c82e1b6/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:58:51.978716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff6f2-3be4-423c-8788-8d6d94f3f9b5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:51.979012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff6f2-3be4-423c-8788-8d6d94f3f9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:51.979294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff6f2-3be4-423c-8788-8d6d94f3f9b5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:51.980628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 19/38] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:51.981447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ff6f2-3be4-423c-8788-8d6d94f3f9b5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:52.013628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:52.115472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ff6f2-3be4-423c-8788-8d6d94f3f9b5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:52.164490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160388-f7b5-466b-9c96-1e7e0016bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:52.165101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160388-f7b5-466b-9c96-1e7e0016bcdc None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:52.168203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160388-f7b5-466b-9c96-1e7e0016bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:52.168203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160388-f7b5-466b-9c96-1e7e0016bcdc None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:52.168203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160388-f7b5-466b-9c96-1e7e0016bcdc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:52.168203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160388-f7b5-466b-9c96-1e7e0016bcdc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:52.186244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 16 20:58:51 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:58:52.187659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34e28-28fd-4d8c-bafe-825b557e7d90 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:52.187958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34e28-28fd-4d8c-bafe-825b557e7d90 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:52.188279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b34e28-28fd-4d8c-bafe-825b557e7d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:52.207886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b0b34e28-28fd-4d8c-bafe-825b557e7d90 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:52.208323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 20/40] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 16 20:58:51 2022] POST /identity/v3/roles => generated 219 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:58:52.209717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b0b34e28-28fd-4d8c-bafe-825b557e7d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:52.307818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 21/41] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:58:52.333477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:52.425076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649262e-fa31-41bd-8880-7cbb934e8f3d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:52.425377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649262e-fa31-41bd-8880-7cbb934e8f3d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:52.425569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649262e-fa31-41bd-8880-7cbb934e8f3d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:52.427679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 22/42] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:58:52.433455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773712-6cb8-4f1c-b5e4-17fa26e56fdd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:52.433874 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773712-6cb8-4f1c-b5e4-17fa26e56fdd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:52.434987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a773712-6cb8-4f1c-b5e4-17fa26e56fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:52.453226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:52.456777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3a773712-6cb8-4f1c-b5e4-17fa26e56fdd None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:52.458185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3a773712-6cb8-4f1c-b5e4-17fa26e56fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:52.460569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bc149-eb1d-4866-945e-652619f49055 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:52.479681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:52.513614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:52.514312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:52.514602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:52.514883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:52.515805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:52.518174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:52.536243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 21/43] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 16 20:58:52 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:58:52.564069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 23/44] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:58:52.593213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:52.707350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c1a6c-a882-4ef1-938a-df9899c8c6c6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:52.743944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54733c8c-1a9f-4c36-b241-87b641179333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:52.744787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733c8c-1a9f-4c36-b241-87b641179333 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:52.745163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733c8c-1a9f-4c36-b241-87b641179333 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:52.745448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54733c8c-1a9f-4c36-b241-87b641179333 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:52.746812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733c8c-1a9f-4c36-b241-87b641179333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:52.748384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54733c8c-1a9f-4c36-b241-87b641179333 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:52.750207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 22/45] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:52.755784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a773712-6cb8-4f1c-b5e4-17fa26e56fdd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:52.856629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a773712-6cb8-4f1c-b5e4-17fa26e56fdd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:52.889793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab1315-3ab9-4bb6-bd20-f8d9a4518aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:52.890451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab1315-3ab9-4bb6-bd20-f8d9a4518aed None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:52.890738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab1315-3ab9-4bb6-bd20-f8d9a4518aed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:52.891019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab1315-3ab9-4bb6-bd20-f8d9a4518aed None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:52.891739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab1315-3ab9-4bb6-bd20-f8d9a4518aed None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:52.893234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab1315-3ab9-4bb6-bd20-f8d9a4518aed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:52.912730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:52.924374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 20:58:52 2022] POST /identity/v3/projects => generated 312 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:58:54.422539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccadb97-e6a6-458b-bbf7-8559ae038cab None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:54.423057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccadb97-e6a6-458b-bbf7-8559ae038cab None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:54.423139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccadb97-e6a6-458b-bbf7-8559ae038cab None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:54.424530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 23/47] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:54.429756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576ab2d-af15-4994-b8ec-6f7c51c358cc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:54.430154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576ab2d-af15-4994-b8ec-6f7c51c358cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:54.430327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7576ab2d-af15-4994-b8ec-6f7c51c358cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:54.447219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7576ab2d-af15-4994-b8ec-6f7c51c358cc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:54.448429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7576ab2d-af15-4994-b8ec-6f7c51c358cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:54.520448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 25/48] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:58:54.542843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccadb97-e6a6-458b-bbf7-8559ae038cab None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:54.568379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:54.650707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccadb97-e6a6-458b-bbf7-8559ae038cab None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:54.686189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:54.686926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:54.687214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:54.687495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:54.699324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:58:54.708892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:58:54.709706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:58:54.710452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 24/49] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:58:54.715984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576ab2d-af15-4994-b8ec-6f7c51c358cc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:54.812844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7576ab2d-af15-4994-b8ec-6f7c51c358cc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:54.839993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:54.846165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:54.847096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:54.847397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:54.847681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:54.848466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:58:54.848782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:54.850185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:54.859055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 26/50] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:54.864414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:54.946461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:54.964934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc609de-88ae-4ebd-8f60-828af05551f0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:54.999184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29a907-98ec-4a9e-8aa4-d42f7ba474c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:55.000366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a907-98ec-4a9e-8aa4-d42f7ba474c4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:55.000656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a907-98ec-4a9e-8aa4-d42f7ba474c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:55.000935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29a907-98ec-4a9e-8aa4-d42f7ba474c4 None admin] PATH_INFO: `/v3/users/80358824790f4a5498dad87c4c82e1b6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:55.002132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29a907-98ec-4a9e-8aa4-d42f7ba474c4 None admin] RBAC: Authorizing `identity:get_user(user_id=80358824790f4a5498dad87c4c82e1b6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:55.003589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29a907-98ec-4a9e-8aa4-d42f7ba474c4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:55.005247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 25/51] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:58:54 2022] GET /identity/v3/users/80358824790f4a5498dad87c4c82e1b6 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:55.010622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:55.093849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326290ab-20d1-434e-a886-892478f91d91 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:55.094146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326290ab-20d1-434e-a886-892478f91d91 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:55.094432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326290ab-20d1-434e-a886-892478f91d91 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:55.095811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 26/52] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:55.100800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f871-b76e-47c7-8ffd-79bbae115884 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:55.101079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f871-b76e-47c7-8ffd-79bbae115884 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:55.101366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043f871-b76e-47c7-8ffd-79bbae115884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:55.114040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e155da-876b-431d-bd34-ceb846249e01 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:55.119652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6043f871-b76e-47c7-8ffd-79bbae115884 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:55.121245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6043f871-b76e-47c7-8ffd-79bbae115884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:55.146271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:55.147070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:55.147360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:55.147642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:55.148813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:55.150259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:55.151891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:55.158065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:55.189253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 27/54] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:58:55.212418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f871-b76e-47c7-8ffd-79bbae115884 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:55.216043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:55.257560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e802aef-791e-412a-9f94-60f486fecfc9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:55.293807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:55.295392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:55.296190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:55.296527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:55.296906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:55.297744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.domain.id=default, user.id=80358824790f4a5498dad87c4c82e1b6) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:58:55.298060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:55.299514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:55.305614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Jun 16 20:58:55 2022] GET /identity/v3/role_assignments?user.id=80358824790f4a5498dad87c4c82e1b6&scope.domain.id=default&role.id=b7564b3ff8064aa09459135574f0a043 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:55.314170 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043f871-b76e-47c7-8ffd-79bbae115884 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:55.350992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1e1f1-a2a1-446b-b88d-5e7f26bec844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:55.351799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1e1f1-a2a1-446b-b88d-5e7f26bec844 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:55.352113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1e1f1-a2a1-446b-b88d-5e7f26bec844 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:55.352418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1e1f1-a2a1-446b-b88d-5e7f26bec844 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:55.353637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1e1f1-a2a1-446b-b88d-5e7f26bec844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:55.355114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1e1f1-a2a1-446b-b88d-5e7f26bec844 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:55.362248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 28/56] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:58:55.363418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:55.466437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e3f24-f4e1-481b-9f0f-401fc1368092 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:55.490032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:55.502145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f931b-6af4-4f5e-ada3-5a47cce8f276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:55.502818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f931b-6af4-4f5e-ada3-5a47cce8f276 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:55.503106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f931b-6af4-4f5e-ada3-5a47cce8f276 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:55.503391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f931b-6af4-4f5e-ada3-5a47cce8f276 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:55.504123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f931b-6af4-4f5e-ada3-5a47cce8f276 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:55.505608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f931b-6af4-4f5e-ada3-5a47cce8f276 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:55.530782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 29/57] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Jun 16 20:58:55 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:58:57.648799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131cbf3-e51c-4db1-b836-e7f94760925f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:57.649340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131cbf3-e51c-4db1-b836-e7f94760925f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:57.649340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131cbf3-e51c-4db1-b836-e7f94760925f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:57.650716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 29/58] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:58:57.656036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315bb0-5ed6-4737-a2bc-e313a3ec24f0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:57.656480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315bb0-5ed6-4737-a2bc-e313a3ec24f0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:57.656644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315bb0-5ed6-4737-a2bc-e313a3ec24f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:57.673530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3f315bb0-5ed6-4737-a2bc-e313a3ec24f0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:58:57.674726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3f315bb0-5ed6-4737-a2bc-e313a3ec24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:58:57.740302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:58:57.764729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131cbf3-e51c-4db1-b836-e7f94760925f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:57.868991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131cbf3-e51c-4db1-b836-e7f94760925f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:57.901330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9fd3ba-e16c-427a-9934-90e51809d021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:57.902114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd3ba-e16c-427a-9934-90e51809d021 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:57.902393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd3ba-e16c-427a-9934-90e51809d021 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:57.902670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9fd3ba-e16c-427a-9934-90e51809d021 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:57.903826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fd3ba-e16c-427a-9934-90e51809d021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:57.905286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9fd3ba-e16c-427a-9934-90e51809d021 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:57.906874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 30/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:58:57.912466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315bb0-5ed6-4737-a2bc-e313a3ec24f0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:58:58.007186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315bb0-5ed6-4737-a2bc-e313a3ec24f0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:58:58.014662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:58:58.041105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451aa11d-6ecd-49a5-b05b-a6b9c1f09202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:58:58.041765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aa11d-6ecd-49a5-b05b-a6b9c1f09202 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:58:58.042049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aa11d-6ecd-49a5-b05b-a6b9c1f09202 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:58:58.042326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451aa11d-6ecd-49a5-b05b-a6b9c1f09202 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:58:58.043030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aa11d-6ecd-49a5-b05b-a6b9c1f09202 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:58:58.045085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451aa11d-6ecd-49a5-b05b-a6b9c1f09202 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:58:58.069435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 31/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:58:57 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:01.234886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74814b5-2fb3-4750-8eb1-8031684a4cc7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.235908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74814b5-2fb3-4750-8eb1-8031684a4cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.236418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74814b5-2fb3-4750-8eb1-8031684a4cc7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.237998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 31/62] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:01.243391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1f9b-5a6b-4590-97ec-fcca77b0e884 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.243808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1f9b-5a6b-4590-97ec-fcca77b0e884 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.243958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc1f9b-5a6b-4590-97ec-fcca77b0e884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.269139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a8fc1f9b-5a6b-4590-97ec-fcca77b0e884 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:01.270571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a8fc1f9b-5a6b-4590-97ec-fcca77b0e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:01.369669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 32/63] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:01.417674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74814b5-2fb3-4750-8eb1-8031684a4cc7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:01.436622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f7271-5181-4d96-993b-6ccc248add97 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.436919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f7271-5181-4d96-993b-6ccc248add97 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.437194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f7271-5181-4d96-993b-6ccc248add97 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.438833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 33/64] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:01.443371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:01.444233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3289-488a-44dd-b876-1ed181836949 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.444233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3289-488a-44dd-b876-1ed181836949 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.444503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f3289-488a-44dd-b876-1ed181836949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.470810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-607f3289-488a-44dd-b876-1ed181836949 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:01.472289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-607f3289-488a-44dd-b876-1ed181836949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:01.615677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 34/65] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:01.627150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f01da-9aee-42bf-9159-ddabb2c95022 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.627695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f01da-9aee-42bf-9159-ddabb2c95022 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.628185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f01da-9aee-42bf-9159-ddabb2c95022 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.630147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 35/66] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:01.635954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f01da-9aee-42bf-9159-ddabb2c95022 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:01.637951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74814b5-2fb3-4750-8eb1-8031684a4cc7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:01.666777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:01.684932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca66508-c6e1-4a94-a1f9-2404ac45ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:01.686151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66508-c6e1-4a94-a1f9-2404ac45ab0f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.686656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66508-c6e1-4a94-a1f9-2404ac45ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.687120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca66508-c6e1-4a94-a1f9-2404ac45ab0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.701419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca66508-c6e1-4a94-a1f9-2404ac45ab0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-cca66508-c6e1-4a94-a1f9-2404ac45ab0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:01.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:01.713168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:01.713903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:01.717037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 32/67] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:01.718464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408c55-d286-426e-9326-5a330b9c986d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.718889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408c55-d286-426e-9326-5a330b9c986d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.719287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408c55-d286-426e-9326-5a330b9c986d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.741187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-84408c55-d286-426e-9326-5a330b9c986d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:01.743287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-84408c55-d286-426e-9326-5a330b9c986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:01.762498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f01da-9aee-42bf-9159-ddabb2c95022 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:01.799389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:01.800542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.800996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.801468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.814797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:01.823432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:01.824521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:01.825306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:01.828408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 36/68] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:01.829595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:01.832358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 33/69] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:01.835425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408c55-d286-426e-9326-5a330b9c986d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:01.856986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:01.937037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:01.958649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0266252-3b0f-4665-8bfb-8967de51ff0c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:01.962674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408c55-d286-426e-9326-5a330b9c986d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:01.996283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:01.997471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:01.997762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:01.998045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:01.998819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:01.999189 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.000610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.001619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e106ab-f2f2-4814-80f1-97056e927ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.002495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e106ab-f2f2-4814-80f1-97056e927ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.002789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e106ab-f2f2-4814-80f1-97056e927ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.003207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e106ab-f2f2-4814-80f1-97056e927ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.003995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e106ab-f2f2-4814-80f1-97056e927ba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:02.004345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e106ab-f2f2-4814-80f1-97056e927ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.005796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e106ab-f2f2-4814-80f1-97056e927ba4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.015199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 37/70] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:02.015199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.023077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 34/71] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:02.023077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2be033-751d-4688-bd18-844b8af02070 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.023077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2be033-751d-4688-bd18-844b8af02070 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.023077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2be033-751d-4688-bd18-844b8af02070 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.023077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 35/72] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:02.028413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2be033-751d-4688-bd18-844b8af02070 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.103913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.119617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302467a4-8131-4880-9014-a521a99ea8ad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.139724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2be033-751d-4688-bd18-844b8af02070 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.152398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.153454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.153741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.154018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.163805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:02.172537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:02.173425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:02.174163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 38/73] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:02.174763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.174831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41dfc1-9585-47e1-93bb-dcb9941f4b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.179968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41dfc1-9585-47e1-93bb-dcb9941f4b72 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.179968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41dfc1-9585-47e1-93bb-dcb9941f4b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.179968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41dfc1-9585-47e1-93bb-dcb9941f4b72 None admin] PATH_INFO: `/v3/users/80358824790f4a5498dad87c4c82e1b6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.179968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41dfc1-9585-47e1-93bb-dcb9941f4b72 None admin] RBAC: Authorizing `identity:get_user(user_id=80358824790f4a5498dad87c4c82e1b6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.179968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41dfc1-9585-47e1-93bb-dcb9941f4b72 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.181038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 36/74] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/users/80358824790f4a5498dad87c4c82e1b6 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:02.181137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.181884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154505f8-2a86-4700-93fc-5078b36acff6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.182213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154505f8-2a86-4700-93fc-5078b36acff6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.182535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154505f8-2a86-4700-93fc-5078b36acff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.199129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-154505f8-2a86-4700-93fc-5078b36acff6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:02.201159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-154505f8-2a86-4700-93fc-5078b36acff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:02.271111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 37/75] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:02.272326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55115f-8846-40a3-8693-e93e91c96d33 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.272622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55115f-8846-40a3-8693-e93e91c96d33 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.272902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55115f-8846-40a3-8693-e93e91c96d33 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.274635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 38/76] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:02.275530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55115f-8846-40a3-8693-e93e91c96d33 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.297028 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20684-f009-49da-afa4-a223efb3098d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.331643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.332604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.332888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.333163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.342020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.347678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.349196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.350898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 39/77] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:02.351664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.381512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55115f-8846-40a3-8693-e93e91c96d33 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.414277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.417177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab372e65-df7a-4cea-827c-d1765398837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.417843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab372e65-df7a-4cea-827c-d1765398837d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.418659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab372e65-df7a-4cea-827c-d1765398837d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.418933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab372e65-df7a-4cea-827c-d1765398837d None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.419675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab372e65-df7a-4cea-827c-d1765398837d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:02.419979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab372e65-df7a-4cea-827c-d1765398837d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.421382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab372e65-df7a-4cea-827c-d1765398837d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.429308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:02.430568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6246c-b4d8-4d12-8292-bc05c3ee203d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.430863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6246c-b4d8-4d12-8292-bc05c3ee203d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.431142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6246c-b4d8-4d12-8292-bc05c3ee203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.447247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e0a6246c-b4d8-4d12-8292-bc05c3ee203d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:02.448454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e0a6246c-b4d8-4d12-8292-bc05c3ee203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:02.457067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e54ef-9aca-4d67-a630-f5cd4be6e0f7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.490519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.491289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.491582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.491883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.514434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 40/79] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:02.515539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6246c-b4d8-4d12-8292-bc05c3ee203d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.564595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.566079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.584268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.626974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6246c-b4d8-4d12-8292-bc05c3ee203d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.630266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.660647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.661370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.661678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.661956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.669375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 40/80] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:02.670211 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.672087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:02.680380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:02.681232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:02.681989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:02.682597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.771339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e76cd8-bb62-43d7-a18e-b768ada3018a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.780353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a8851-e596-401b-aee9-7d8e7f67d85f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.797070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.805981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.806629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.806911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.807185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.814240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.815105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.815384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.815661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.816875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.818341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.819967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 42/82] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:02.820754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.838005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:02.876639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.878135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.920242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a07c9-1318-4971-b141-06c5e33a3bbd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:02.953943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:02.954741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:02.955029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:02.955313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:02.956528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:02.957959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:02.959767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 43/83] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:02.960376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:02.980720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 41/84] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:02.981865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.021455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.041622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.065414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b46af-3b47-4508-85a8-5529e16c7aca None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.080843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0fe1-ca0c-4b17-8070-0e7682f23afd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.097669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.098537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.098823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.099102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.100313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.101755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.103479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 44/85] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:03.104272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.114836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.115509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.115796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.116075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.116863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:03.117176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.118576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.127080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 42/86] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:03.127849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.203552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d4c4a-1af1-43fa-b540-17aa9ce1b08a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.224885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692355be-81ee-4588-ad0e-b369b5dd52c7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.225347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.237520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.238166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.238449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.238724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.248620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.259750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.260448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.260738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.261021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.261740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.263349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.282813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 43/87] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:03 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:03.283622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.311441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.313101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.401944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc5598-554e-4834-bfe3-7c86ae6afa5c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.435241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 45/88] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:03.435241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.449912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.451085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.451366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.452878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.452983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.454598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.456306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 44/89] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:03.456988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.462732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.516490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.553924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ea467-f00b-48d7-8a92-9e54b858abdd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.592766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bea5e-b7fa-4ce6-8c22-b4f7af609465 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.606449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.607673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.607967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.608449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.609296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=80358824790f4a5498dad87c4c82e1b6) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:03.609613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.611078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.621177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 46/90] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/role_assignments?user.id=80358824790f4a5498dad87c4c82e1b6&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:03.621177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.639334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.640281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.640571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.640851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.642932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.644466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.646137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 45/91] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:03.646922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.742862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.763836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1730a-1a93-43d3-b1db-353468495c4c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.801664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce86156-179d-449e-9baa-b1d5664d535f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:03.836623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.837531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.837816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.838098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.839039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:03.840343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.842038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.845177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 47/92] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:03.851143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:03.882932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:03.883763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:03.884159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:03.884470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:03.885383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=4e3d837f340948cd83d27b91759a8878) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:03.885701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:03.887485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:03.900204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/role_assignments?user.id=4e3d837f340948cd83d27b91759a8878&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:03.901056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:04.033628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be868a8c-d4a6-4fef-af3e-4593ed64a550 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:04.082925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d8648-36ad-46ae-bcc8-9a5a4cecceb1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:04.114262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:04.115275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:04.116671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:04.117176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:04.190467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:04.193910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:04.194794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:04.196391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:04.196940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:04.198075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] RBAC: Adding query filter params (role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=4e3d837f340948cd83d27b91759a8878) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:04.198584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:04.204415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:04.218973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 47/94] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/role_assignments?user.id=4e3d837f340948cd83d27b91759a8878&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=0f03c426f04e463da379c4eda6247694 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:04.321400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:04.322952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:04.470141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 48/95] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:04.476493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:04.568566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:04.622071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3726f93-7058-4e6a-bee5-049565f6a20d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:04.681899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442276-622b-481e-8c48-376639ec1394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:04.682806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442276-622b-481e-8c48-376639ec1394 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:04.683094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442276-622b-481e-8c48-376639ec1394 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:04.683377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442276-622b-481e-8c48-376639ec1394 None admin] PATH_INFO: `/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:04.689041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b442276-622b-481e-8c48-376639ec1394 None admin] RBAC: Authorizing `identity:get_project(project_id=9f7f6a964c2f4eac8cda947f6cac7790)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:04.690547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b442276-622b-481e-8c48-376639ec1394 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:04.692356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 48/96] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:04 2022] GET /identity/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:04.698519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:04.793973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:04.908807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7646c4-ada1-44b4-bcb0-debf155b9448 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:04.958948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31ff14-4ee0-4863-9175-03f25dee9379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:04.959608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ff14-4ee0-4863-9175-03f25dee9379 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:04.959892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ff14-4ee0-4863-9175-03f25dee9379 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:04.960183 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31ff14-4ee0-4863-9175-03f25dee9379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:04.961021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31ff14-4ee0-4863-9175-03f25dee9379 None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=9f7f6a964c2f4eac8cda947f6cac7790, user.id=4e3d837f340948cd83d27b91759a8878) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:04.961335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31ff14-4ee0-4863-9175-03f25dee9379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:04.962770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31ff14-4ee0-4863-9175-03f25dee9379 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:04.972425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 49/97] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:04 2022] GET /identity/v3/role_assignments?user.id=4e3d837f340948cd83d27b91759a8878&scope.project.id=9f7f6a964c2f4eac8cda947f6cac7790&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:06.524151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6765-a268-4b36-aff4-34c908824e99 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:06.525186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6765-a268-4b36-aff4-34c908824e99 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:06.525671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf6765-a268-4b36-aff4-34c908824e99 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:06.527248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 49/98] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:06.533771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16afb47-7deb-451d-a14b-93bb61e81885 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:06.534587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16afb47-7deb-451d-a14b-93bb61e81885 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:06.535066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16afb47-7deb-451d-a14b-93bb61e81885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:06.553829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b16afb47-7deb-451d-a14b-93bb61e81885 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:06.555368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b16afb47-7deb-451d-a14b-93bb61e81885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:06.664612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 50/99] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:06.685145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ba56c-4c75-4174-84e0-7e0f2e1c7701 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:06.685775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ba56c-4c75-4174-84e0-7e0f2e1c7701 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:06.686260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ba56c-4c75-4174-84e0-7e0f2e1c7701 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:06.687885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 50/100] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:06.700751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9a02-ca21-48be-9271-70bcef662047 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:06.701041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9a02-ca21-48be-9271-70bcef662047 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:06.701316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9a02-ca21-48be-9271-70bcef662047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:06.706229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ba56c-4c75-4174-84e0-7e0f2e1c7701 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:06.723840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d35c9a02-ca21-48be-9271-70bcef662047 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:06.725234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d35c9a02-ca21-48be-9271-70bcef662047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:06.791069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:06.849360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 51/101] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:06.852589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e564ac-d3ec-4353-9e02-9d6f83d29b1b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:06.853792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e564ac-d3ec-4353-9e02-9d6f83d29b1b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:06.856710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e564ac-d3ec-4353-9e02-9d6f83d29b1b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:06.858271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 52/102] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:06.865516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d10d1c-0bae-4f5d-931f-7d0e0cfe6f5c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:06.866089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d10d1c-0bae-4f5d-931f-7d0e0cfe6f5c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:06.866572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d10d1c-0bae-4f5d-931f-7d0e0cfe6f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:06.907350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d6d10d1c-0bae-4f5d-931f-7d0e0cfe6f5c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:06.909802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d6d10d1c-0bae-4f5d-931f-7d0e0cfe6f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:06.923517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ba56c-4c75-4174-84e0-7e0f2e1c7701 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:06.958814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:06.969948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:06.971043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:06.971520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:06.972274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:06.973799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:06.978424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:06.980306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 51/103] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:06.984768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.060419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 53/104] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:07.061705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d10d1c-0bae-4f5d-931f-7d0e0cfe6f5c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.175383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c22192-d510-420d-bdad-1f07b997280f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.210168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d10d1c-0bae-4f5d-931f-7d0e0cfe6f5c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.223584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:07.225364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.227264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.227264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.227264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.238450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:07.246989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:07.247940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:07.248775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 52/105] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:07.249428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.258844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ea607-888f-4944-a4db-053ffddfa78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.260144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea607-888f-4944-a4db-053ffddfa78d None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.260638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea607-888f-4944-a4db-053ffddfa78d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.261064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ea607-888f-4944-a4db-053ffddfa78d None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.262580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ea607-888f-4944-a4db-053ffddfa78d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:07.264916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ea607-888f-4944-a4db-053ffddfa78d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:07.297683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:07.302385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 54/106] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 20:59:07 2022] POST /identity/v3/projects => generated 302 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:07.304234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd341a-9d3f-4fb4-875f-735333d17028 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.304682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd341a-9d3f-4fb4-875f-735333d17028 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.305511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd341a-9d3f-4fb4-875f-735333d17028 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.307421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 55/107] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:07.308404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd341a-9d3f-4fb4-875f-735333d17028 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.372137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afba02-d7a4-4db9-ac51-927e3b642cc4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.427154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf004a-1c2d-4100-a7a1-6d415e10593c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.427990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf004a-1c2d-4100-a7a1-6d415e10593c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.428758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf004a-1c2d-4100-a7a1-6d415e10593c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.428758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf004a-1c2d-4100-a7a1-6d415e10593c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.455692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf004a-1c2d-4100-a7a1-6d415e10593c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-89bf004a-1c2d-4100-a7a1-6d415e10593c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:07.463906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:07.464902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:07.465915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 53/108] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:07.467132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a3da3-81b6-4762-84f9-c99eb5f5ae40 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.469914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a3da3-81b6-4762-84f9-c99eb5f5ae40 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.469914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3a3da3-81b6-4762-84f9-c99eb5f5ae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.493451 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd341a-9d3f-4fb4-875f-735333d17028 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.500205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7e3a3da3-81b6-4762-84f9-c99eb5f5ae40 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:07.501452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7e3a3da3-81b6-4762-84f9-c99eb5f5ae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:07.552476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.553217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.553509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.553840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.554900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:07.555219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:07.557361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:07.572104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 56/109] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:07.573346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.607218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:07.611208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 54/110] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:07.612621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a3da3-81b6-4762-84f9-c99eb5f5ae40 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.664742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:07.739651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbce92-df68-4623-8a0f-cfad6f405c53 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.751857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3a3da3-81b6-4762-84f9-c99eb5f5ae40 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.785956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b8add8-1b3f-44b4-ad18-668cffe496a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.786796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8add8-1b3f-44b4-ad18-668cffe496a6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.787093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8add8-1b3f-44b4-ad18-668cffe496a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.787373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8add8-1b3f-44b4-ad18-668cffe496a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.788130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8add8-1b3f-44b4-ad18-668cffe496a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:07.788477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8add8-1b3f-44b4-ad18-668cffe496a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:07.789915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b8add8-1b3f-44b4-ad18-668cffe496a6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:07.791687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.792604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.792942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.793442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] PATH_INFO: `/v3/users/80358824790f4a5498dad87c4c82e1b6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.794717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] RBAC: Authorizing `identity:get_user(user_id=80358824790f4a5498dad87c4c82e1b6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:07.796158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:07.798216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 55/111] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:07 2022] GET /identity/v3/users/80358824790f4a5498dad87c4c82e1b6 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:07.798713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 57/112] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:07.799910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a84a1-5810-408a-b7d0-6cf645a3f603 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.800225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a84a1-5810-408a-b7d0-6cf645a3f603 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.800520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a84a1-5810-408a-b7d0-6cf645a3f603 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.802239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 58/113] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:07.802434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.803339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a84a1-5810-408a-b7d0-6cf645a3f603 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.908342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:07.913599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:07.918207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5320e-1b8f-4a2a-b001-0d67efc6aec8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.923222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a84a1-5810-408a-b7d0-6cf645a3f603 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:07.956155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.956989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.957277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.957549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.966830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc93b42-1ebe-4bc2-a505-3d1af7b42ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:07.967956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc93b42-1ebe-4bc2-a505-3d1af7b42ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.968060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:07.968618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc93b42-1ebe-4bc2-a505-3d1af7b42ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.969092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc93b42-1ebe-4bc2-a505-3d1af7b42ab9 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.970481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc93b42-1ebe-4bc2-a505-3d1af7b42ab9 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:07.972423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc93b42-1ebe-4bc2-a505-3d1af7b42ab9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:07.974319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 59/114] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:07 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:07.979289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:07.980104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:07.980990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:07.981586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f5ff2-b4a5-43b1-b36e-7eecb92af8b0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:07.981586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f5ff2-b4a5-43b1-b36e-7eecb92af8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:07.981586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f5ff2-b4a5-43b1-b36e-7eecb92af8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:07.981762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 56/115] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:07.981762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:07.999385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-785f5ff2-b4a5-43b1-b36e-7eecb92af8b0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:08.000597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-785f5ff2-b4a5-43b1-b36e-7eecb92af8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:08.074827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 60/116] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:08.076624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a80c21-7a40-47ea-a93b-21722294485a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.076995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a80c21-7a40-47ea-a93b-21722294485a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.077390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a80c21-7a40-47ea-a93b-21722294485a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.078933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 61/117] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:08.083458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a80c21-7a40-47ea-a93b-21722294485a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.098221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf339cc-a412-47a6-aab3-05de1a01245f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.132514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.133497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.133784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.134065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.135268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:08.137292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:08.138961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 57/118] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:07 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:08.139729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.167517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:08.187514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:08.212464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a80c21-7a40-47ea-a93b-21722294485a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.244590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5b387-1ee8-44ce-802a-dab541f8e8b2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.254553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9508562-63c4-456a-9d41-c3b283550d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.255774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9508562-63c4-456a-9d41-c3b283550d3b None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.256342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9508562-63c4-456a-9d41-c3b283550d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.256633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9508562-63c4-456a-9d41-c3b283550d3b None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6/users/80358824790f4a5498dad87c4c82e1b6/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.258631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9508562-63c4-456a-9d41-c3b283550d3b None admin] RBAC: Authorizing `identity:create_grant(project_id=e59320347df34780a2d5d9326481f6a6, user_id=80358824790f4a5498dad87c4c82e1b6, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:08.260100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9508562-63c4-456a-9d41-c3b283550d3b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:08.284205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 62/119] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:08 2022] PUT /identity/v3/projects/e59320347df34780a2d5d9326481f6a6/users/80358824790f4a5498dad87c4c82e1b6/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:08.284205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71ada2-417c-469d-bf5b-fe33b110566f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.284205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71ada2-417c-469d-bf5b-fe33b110566f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.284205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71ada2-417c-469d-bf5b-fe33b110566f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.292566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.294056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.294507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.294803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.295637 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:08.296000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:08.297574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:08.301705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2c71ada2-417c-469d-bf5b-fe33b110566f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:08.302949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2c71ada2-417c-469d-bf5b-fe33b110566f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:08.308472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 58/120] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:08.309839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.387675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 63/121] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:08.388987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71ada2-417c-469d-bf5b-fe33b110566f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.430284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:08.445013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b346ba-2bd1-40c9-8bbc-9ee56562cadf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.489681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.490547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.490850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.491093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.504122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:08.504489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:08.512770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:08.513948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:08.514706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 59/122] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:08.515422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.548834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71ada2-417c-469d-bf5b-fe33b110566f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.602709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.603585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.603877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.604160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.607385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:08.608913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:08.610968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 64/123] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:08 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:08.611931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.645185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64bea3-e50e-44f8-b997-3e908f0ea564 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.688682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.689649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.690667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.690979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] PATH_INFO: `/v3/users/60c692234f6b47588ab7adce27a17364` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.712875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] RBAC: Authorizing `identity:get_user(user_id=60c692234f6b47588ab7adce27a17364)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:08.716227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:08.718194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 60/124] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:08 2022] GET /identity/v3/users/60c692234f6b47588ab7adce27a17364 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:08.719508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.731616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:08.747491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a2593-94b0-45fd-bb10-8d41842c03b4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.792081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.793301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.793974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.794484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.803239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:08.806636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:08.816638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:08.817494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:08.818244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:08.826062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 65/125] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:08.827237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.845447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08450-ceeb-4e2b-993a-2078dea5b090 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.884928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.886012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.886498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.887550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:08.888690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:08.889254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:08.890842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:08.899721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 61/126] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:08.900829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:08.948665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1010f-3452-405c-8131-a095b929fcbd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:08.984198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:08.996898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:08.998161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:08.998461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:08.998745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6/users/4e3d837f340948cd83d27b91759a8878/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.001248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] RBAC: Authorizing `identity:create_grant(project_id=e59320347df34780a2d5d9326481f6a6, user_id=4e3d837f340948cd83d27b91759a8878, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.003115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.022355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 66/127] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:08 2022] PUT /identity/v3/projects/e59320347df34780a2d5d9326481f6a6/users/4e3d837f340948cd83d27b91759a8878/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:09.023640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.025861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c4ac4-037b-4135-961a-2dd723d8d404 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:09.080792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:09.081609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:09.081905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:09.082185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.104692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:09.180326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.182772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.225926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25b309-69b5-4d55-aff0-ac178f5e3308 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:09.267276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:09.286129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:09.286918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:09.287260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:09.287547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.288346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:09.288658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.290095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.301645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 67/128] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:09.302526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.316518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 62/129] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:09.317590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.440025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb530d52-693e-48ca-a7ab-bdd9e753615b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:09.454168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e5a9-0376-46a4-95f4-83b5d0acc781 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:09.479754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:09.480980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:09.481421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:09.482244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.483618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.485428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.487220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 63/130] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:09 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:09.488341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.526375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:09.534044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:09.599866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736204ea-0ea3-4f44-b357-ef4d84ebf77f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:09.612955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:09.613873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:09.614158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:09.614457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.617589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.619065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.624974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 68/131] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:09 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:09.625973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.646464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:09.647937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:09.648393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:09.648810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.650150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.651779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.654624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 64/132] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:09 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:09.656381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.812623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c2feb-6a18-49e4-89ca-c96c6c3d35c9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:09.846167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88821596-cc91-4287-8403-bd6d1089efca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:09.850916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:09.853299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:09.854186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:09.854479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:09.854758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.856032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.857653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.859538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 69/133] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:09 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:09.860765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.893790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:09.894657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:09.894935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:09.895203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] PATH_INFO: `/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:09.896418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] RBAC: Authorizing `identity:get_project(project_id=9f7f6a964c2f4eac8cda947f6cac7790)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:09.897969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:09.899668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 65/134] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:09 2022] GET /identity/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790 => generated 312 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:09.900555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:09.948633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:09.995034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309f0cc-1fb9-4c89-b4b7-bdbbd0a8f90d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:10.008369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621cf4b-28b3-48c0-8ecf-40ce7f1e31c7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:10.040484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b858b-1613-4a45-b218-4bc537289188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:10.041170 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b858b-1613-4a45-b218-4bc537289188 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.041449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b858b-1613-4a45-b218-4bc537289188 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.041732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b858b-1613-4a45-b218-4bc537289188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.042574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b858b-1613-4a45-b218-4bc537289188 None admin] RBAC: Adding query filter params (role.id=75eaf9dbf23b401bb28030c3c0d2d561, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=60c692234f6b47588ab7adce27a17364) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:10.042891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b858b-1613-4a45-b218-4bc537289188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:10.045064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b858b-1613-4a45-b218-4bc537289188 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:10.046579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0c7f9-f860-48d2-90ff-ec9d716335e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:10.047805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0c7f9-f860-48d2-90ff-ec9d716335e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.048357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0c7f9-f860-48d2-90ff-ec9d716335e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.048821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0c7f9-f860-48d2-90ff-ec9d716335e1 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6/users/4e3d837f340948cd83d27b91759a8878/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.051222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 70/135] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:09 2022] GET /identity/v3/role_assignments?user.id=60c692234f6b47588ab7adce27a17364&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=75eaf9dbf23b401bb28030c3c0d2d561 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:10.051729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0c7f9-f860-48d2-90ff-ec9d716335e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e59320347df34780a2d5d9326481f6a6, user_id=4e3d837f340948cd83d27b91759a8878, role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:10.052686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa932-f7ab-4b0d-ab8d-6b34ecc21112 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.052979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa932-f7ab-4b0d-ab8d-6b34ecc21112 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.053271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fa932-f7ab-4b0d-ab8d-6b34ecc21112 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.054313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0c7f9-f860-48d2-90ff-ec9d716335e1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:10.054553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 71/136] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:10.059280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa932-f7ab-4b0d-ab8d-6b34ecc21112 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:10.078257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 66/137] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:09 2022] PUT /identity/v3/projects/e59320347df34780a2d5d9326481f6a6/users/4e3d837f340948cd83d27b91759a8878/roles/0f03c426f04e463da379c4eda6247694 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:10.080387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f14c58-37a8-44ef-be5e-b80f22b47ea8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.081025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f14c58-37a8-44ef-be5e-b80f22b47ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.081585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f14c58-37a8-44ef-be5e-b80f22b47ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.102092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-44f14c58-37a8-44ef-be5e-b80f22b47ea8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:10.103842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-44f14c58-37a8-44ef-be5e-b80f22b47ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:10.137256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:10.192625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fa932-f7ab-4b0d-ab8d-6b34ecc21112 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:10.227278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 67/138] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:10.244916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:10.264308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:10.265239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.265527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.265806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] PATH_INFO: `/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790/users/4e3d837f340948cd83d27b91759a8878/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.272730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f7f6a964c2f4eac8cda947f6cac7790, user_id=4e3d837f340948cd83d27b91759a8878, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:10.274414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f14c58-37a8-44ef-be5e-b80f22b47ea8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:10.280808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:10.322653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 72/139] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:10 2022] PUT /identity/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790/users/4e3d837f340948cd83d27b91759a8878/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:10.417151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f14c58-37a8-44ef-be5e-b80f22b47ea8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:10.456029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65338717-690c-4dce-b779-e9c3dc4457e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:10.457274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338717-690c-4dce-b779-e9c3dc4457e8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.457749 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338717-690c-4dce-b779-e9c3dc4457e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.458286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338717-690c-4dce-b779-e9c3dc4457e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.459838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65338717-690c-4dce-b779-e9c3dc4457e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:10.461569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65338717-690c-4dce-b779-e9c3dc4457e8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:10.463459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 68/140] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:10.469408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:10.623000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccdd96-a916-4e63-8771-d540b4094480 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:10.668690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c802392-dcde-491e-94fa-f2e15469157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:10.669349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802392-dcde-491e-94fa-f2e15469157e None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.669627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802392-dcde-491e-94fa-f2e15469157e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.669907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c802392-dcde-491e-94fa-f2e15469157e None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.670644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c802392-dcde-491e-94fa-f2e15469157e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:10.672111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c802392-dcde-491e-94fa-f2e15469157e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:10.708144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 73/141] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:10 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:10.876894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfebb-7dca-43e9-9908-4355315db1fe None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.877965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfebb-7dca-43e9-9908-4355315db1fe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.878456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cfebb-7dca-43e9-9908-4355315db1fe None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.880131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 69/142] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:10.885855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add46684-c35d-4387-910e-c16c94f2444c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:10.886147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add46684-c35d-4387-910e-c16c94f2444c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:10.886454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add46684-c35d-4387-910e-c16c94f2444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:10.913137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-add46684-c35d-4387-910e-c16c94f2444c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:10.914354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-add46684-c35d-4387-910e-c16c94f2444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:10.951085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:11.005946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 74/143] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:11.042703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cfebb-7dca-43e9-9908-4355315db1fe None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:11.089989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:11.181945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cfebb-7dca-43e9-9908-4355315db1fe None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:11.224054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:11.224801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:11.225082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:11.225353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:11.237102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:11.244966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:11.245808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:11.247154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 70/144] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:11.259521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add46684-c35d-4387-910e-c16c94f2444c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:11.400141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add46684-c35d-4387-910e-c16c94f2444c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:11.443265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:11.444316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:11.444797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:11.445297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:11.446239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:11.446738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:11.448358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:11.457729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 75/145] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:11.463625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:11.616389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7712c-d01a-4abf-93d7-12ab39d3714b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:11.618037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:11.655685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5cfbb-2fc9-4a3e-8ad4-e86fd7297c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:11.656603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5cfbb-2fc9-4a3e-8ad4-e86fd7297c7a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:11.656885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5cfbb-2fc9-4a3e-8ad4-e86fd7297c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:11.657161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5cfbb-2fc9-4a3e-8ad4-e86fd7297c7a None admin] PATH_INFO: `/v3/users/80358824790f4a5498dad87c4c82e1b6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:11.658367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5cfbb-2fc9-4a3e-8ad4-e86fd7297c7a None admin] RBAC: Authorizing `identity:get_user(user_id=80358824790f4a5498dad87c4c82e1b6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:11.659842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5cfbb-2fc9-4a3e-8ad4-e86fd7297c7a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:11.661832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 71/146] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:11 2022] GET /identity/v3/users/80358824790f4a5498dad87c4c82e1b6 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:11.667336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:11.724223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:11.814685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f74cff-5d28-47fd-85d7-c2d9c1e3719a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:11.855332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:11.857133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:11.857426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:11.857709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:11.940573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686961c-8435-4b85-848c-097ca8f17b1f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:11.941068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686961c-8435-4b85-848c-097ca8f17b1f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:11.941138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686961c-8435-4b85-848c-097ca8f17b1f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:11.942612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 72/147] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:59:11.943481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:11.945083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:11.948328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127685d4-fe6e-431b-bd6f-12d56476a22a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:11.948621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127685d4-fe6e-431b-bd6f-12d56476a22a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:11.948900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127685d4-fe6e-431b-bd6f-12d56476a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:11.967885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-127685d4-fe6e-431b-bd6f-12d56476a22a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:11.969234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-127685d4-fe6e-431b-bd6f-12d56476a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:11.983563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:12.102867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 73/148] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:12.153105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127685d4-fe6e-431b-bd6f-12d56476a22a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:12.182671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 76/149] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:12.188293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:12.344951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:12.370152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127685d4-fe6e-431b-bd6f-12d56476a22a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:12.403768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e88c9a-f50e-458c-898b-55b88eded4d9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:12.440154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:12.441007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:12.441284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:12.441551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:12.454814 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:12.459302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:12.460167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:12.460525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:12.460776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:12.462025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:12.463531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:12.465815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 77/150] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:12 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:12.467021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:12.475852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:12.478976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:12.479807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:12.480741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 74/151] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:12.504310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:12.648479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf50ae7-439c-451d-bbc9-43080d2bc15d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:12.684959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64251e8d-8523-40ec-9263-e4cc22772996 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:12.705405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:12.706770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:12.707261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:12.707727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:12.708796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=80358824790f4a5498dad87c4c82e1b6) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:12.709308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:12.711802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:12.728413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 78/152] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:12 2022] GET /identity/v3/role_assignments?user.id=80358824790f4a5498dad87c4c82e1b6&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:12.743070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:12.744162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:12.744686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:12.745161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:12.746758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:12.747269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:12.749018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:12.758692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 75/153] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:12.763904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:12.845104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:12.894095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b36391-639f-47d2-9fe9-2841832b0072 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:12.938184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:12.939048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:12.939332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:12.939604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:12.944896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:12.946361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:12.948307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 79/154] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:12 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:12.953951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:12.971982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:13.080283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9c24-2d8c-4894-ae80-e14a96bc0752 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:13.135592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:13.136638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:13.137251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:13.137721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:13.216268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:13.218063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:13.230261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:13.326671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 76/155] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:13.333482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:13.467021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec18a1f-7958-44a6-9498-2b6e454a54f3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:13.499813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:13.510179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275d989-d1d7-4188-916e-b55c94be9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:13.511589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d989-d1d7-4188-916e-b55c94be9614 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:13.511938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d989-d1d7-4188-916e-b55c94be9614 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:13.512237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275d989-d1d7-4188-916e-b55c94be9614 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:13.513527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d989-d1d7-4188-916e-b55c94be9614 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:13.514975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275d989-d1d7-4188-916e-b55c94be9614 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:13.516737 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 80/156] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:13 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:13.522710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:13.670783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba49f8-c721-4beb-8cee-58830278f6a5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:13.684736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:13.719411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981682da-51e8-46c9-b501-1df71a0f738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:13.720456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981682da-51e8-46c9-b501-1df71a0f738f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:13.720954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981682da-51e8-46c9-b501-1df71a0f738f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:13.721455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981682da-51e8-46c9-b501-1df71a0f738f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:13.722805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981682da-51e8-46c9-b501-1df71a0f738f None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=4e3d837f340948cd83d27b91759a8878) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:13.723346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981682da-51e8-46c9-b501-1df71a0f738f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:13.725126 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981682da-51e8-46c9-b501-1df71a0f738f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:13.733394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 77/157] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:13 2022] GET /identity/v3/role_assignments?user.id=4e3d837f340948cd83d27b91759a8878&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:13.882615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53100-357a-40c6-80ca-9f08888aa448 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:13.883117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53100-357a-40c6-80ca-9f08888aa448 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:13.883213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec53100-357a-40c6-80ca-9f08888aa448 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:13.884649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 81/158] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:13.890617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130c9b-4043-47b6-a596-7867521191b0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:13.891258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130c9b-4043-47b6-a596-7867521191b0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:13.891748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21130c9b-4043-47b6-a596-7867521191b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:13.914175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-21130c9b-4043-47b6-a596-7867521191b0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:13.915750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-21130c9b-4043-47b6-a596-7867521191b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:14.017431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 78/159] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:14.056263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53100-357a-40c6-80ca-9f08888aa448 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:14.096607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186897a5-213a-4e9a-8c38-48cafd88d576 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.097525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186897a5-213a-4e9a-8c38-48cafd88d576 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.098000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186897a5-213a-4e9a-8c38-48cafd88d576 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.099586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 79/160] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:14.132768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c3191-1d8b-4419-9d94-1ecddeb22cdc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.133370 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c3191-1d8b-4419-9d94-1ecddeb22cdc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.133867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c3191-1d8b-4419-9d94-1ecddeb22cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.164369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-579c3191-1d8b-4419-9d94-1ecddeb22cdc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:14.166938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-579c3191-1d8b-4419-9d94-1ecddeb22cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:14.271432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec53100-357a-40c6-80ca-9f08888aa448 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:14.283727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 80/161] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 16 20:59:14.293980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602fee-d82b-4443-ab79-162a4f3ff294 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.294583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602fee-d82b-4443-ab79-162a4f3ff294 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.295066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602fee-d82b-4443-ab79-162a4f3ff294 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.296749 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 81/162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:14.302640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915891-1d3e-4641-9e79-fa609eb776cd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.303265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915891-1d3e-4641-9e79-fa609eb776cd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.303741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e915891-1d3e-4641-9e79-fa609eb776cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.330269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:14.331333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.331761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.332237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.343925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6e915891-1d3e-4641-9e79-fa609eb776cd None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:14.346050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6e915891-1d3e-4641-9e79-fa609eb776cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:14.352565 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:14.366280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:14.367335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:14.368401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:14.374659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 82/163] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:14.376638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:14.404904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:14.477690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 82/164] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:14.478548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e915891-1d3e-4641-9e79-fa609eb776cd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:14.491418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:14.566311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cf34d-5e69-4e2f-8624-aa515653ce7c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:14.648417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e915891-1d3e-4641-9e79-fa609eb776cd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:14.651621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:14.653483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.653920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.654414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.674494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:14.687274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:14.688743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:14.689702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:14.691142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 83/165] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:14.692240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:14.692593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:14.693268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.693781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.694255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.695213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:14.695721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:14.697584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:14.713198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 83/166] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:14.714345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:14.774679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:14.840833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de018b-844c-4734-b48f-55d8d6167ddf None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:14.868779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:14.877685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:14.878838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:14.879279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:14.879844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:14.892665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:14.901896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:14.902969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:14.903849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:14.906026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 84/167] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:14.907098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:14.971205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90a48a-35d2-4cb3-95e7-64aa3b183898 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.019738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568527a-b09a-45f5-b290-717478b84d3d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.042285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.043593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.043937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.044237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.045001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:15.045306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.046706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.059490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.060810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.061370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.061791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.063161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.063567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 84/168] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:15.065214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.067024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 85/169] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:14 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:15.068007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.069119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.128729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:15.188615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1a59a-e71d-4990-bcf7-14528e05d073 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.226431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.227641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.228109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.228596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] PATH_INFO: `/v3/users/60c692234f6b47588ab7adce27a17364` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.229988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] RBAC: Authorizing `identity:get_user(user_id=60c692234f6b47588ab7adce27a17364)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.232089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.234100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 86/170] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:15 2022] GET /identity/v3/users/60c692234f6b47588ab7adce27a17364 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:15.235069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.273746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:15.287952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0dedc9-196d-4dd8-9cd7-fa1134ef79dc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.327183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.328610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.329299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.329719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.330868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:15.331315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.333380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.345796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 85/171] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:15.347465 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.348668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197ee5f-d6dc-49fb-94f2-d56ba73030d4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.371846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:15.396624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.397692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.398163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.398632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.469608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca728fe-607f-41dd-941e-7752d84791da None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.475648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.477211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.505283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b931-358c-4523-aa09-80cbc722f826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.506456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b931-358c-4523-aa09-80cbc722f826 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.506943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b931-358c-4523-aa09-80cbc722f826 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.507448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b931-358c-4523-aa09-80cbc722f826 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.509445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428b931-358c-4523-aa09-80cbc722f826 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.511661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428b931-358c-4523-aa09-80cbc722f826 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.514239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 86/172] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:15 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:15.515744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd378-3035-455f-824f-8c905981b218 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.516294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd378-3035-455f-824f-8c905981b218 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.516770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd378-3035-455f-824f-8c905981b218 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.518680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 87/173] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:15.519769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd378-3035-455f-824f-8c905981b218 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.546017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:15.616972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 87/174] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:15.617811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.632917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:15.658497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd378-3035-455f-824f-8c905981b218 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.698827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6e700-7aa9-4d65-96f3-2f6c5f4f6d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.700304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e700-7aa9-4d65-96f3-2f6c5f4f6d0e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.700587 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e700-7aa9-4d65-96f3-2f6c5f4f6d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.700863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6e700-7aa9-4d65-96f3-2f6c5f4f6d0e None admin] PATH_INFO: `/v3/users/4e3d837f340948cd83d27b91759a8878` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.702181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6e700-7aa9-4d65-96f3-2f6c5f4f6d0e None admin] RBAC: Authorizing `identity:get_user(user_id=4e3d837f340948cd83d27b91759a8878)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.703689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6e700-7aa9-4d65-96f3-2f6c5f4f6d0e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.705538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 88/175] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:15 2022] GET /identity/v3/users/4e3d837f340948cd83d27b91759a8878 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:15.707082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194ff6-23ba-40fe-8eab-ce70ac6e8f1d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.707557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194ff6-23ba-40fe-8eab-ce70ac6e8f1d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.707976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d194ff6-23ba-40fe-8eab-ce70ac6e8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.726352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3d194ff6-23ba-40fe-8eab-ce70ac6e8f1d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:15.727594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3d194ff6-23ba-40fe-8eab-ce70ac6e8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:15.742162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426ca79-c6fc-4c4b-8434-3727b47219dc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.778784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726fb317-a615-4964-8ae6-1cdc6faf21b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.779677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fb317-a615-4964-8ae6-1cdc6faf21b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.779953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fb317-a615-4964-8ae6-1cdc6faf21b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.780245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726fb317-a615-4964-8ae6-1cdc6faf21b0 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6/users/60c692234f6b47588ab7adce27a17364/roles/75eaf9dbf23b401bb28030c3c0d2d561` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.782236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fb317-a615-4964-8ae6-1cdc6faf21b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e59320347df34780a2d5d9326481f6a6, user_id=60c692234f6b47588ab7adce27a17364, role_id=75eaf9dbf23b401bb28030c3c0d2d561)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.783681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726fb317-a615-4964-8ae6-1cdc6faf21b0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.796852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 88/176] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:15 2022] PUT /identity/v3/projects/e59320347df34780a2d5d9326481f6a6/users/60c692234f6b47588ab7adce27a17364/roles/75eaf9dbf23b401bb28030c3c0d2d561 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:15.798255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97ac9-fb4c-44f3-94f4-066177c30e1b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.798547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97ac9-fb4c-44f3-94f4-066177c30e1b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.798844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e97ac9-fb4c-44f3-94f4-066177c30e1b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.800121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 89/177] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:15.805184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97ac9-fb4c-44f3-94f4-066177c30e1b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.807427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 89/178] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:15.808651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d194ff6-23ba-40fe-8eab-ce70ac6e8f1d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:15.828582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:15.894798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:15.929907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e97ac9-fb4c-44f3-94f4-066177c30e1b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.931217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d194ff6-23ba-40fe-8eab-ce70ac6e8f1d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:15.970988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.971965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.972708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.972982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.984610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2f4ba-bd62-4457-acf6-42ad16febbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:15.985561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4ba-bd62-4457-acf6-42ad16febbba None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.985846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4ba-bd62-4457-acf6-42ad16febbba None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.986122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2f4ba-bd62-4457-acf6-42ad16febbba None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.987418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f4ba-bd62-4457-acf6-42ad16febbba None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:15.989063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2f4ba-bd62-4457-acf6-42ad16febbba None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:15.996534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 90/179] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:15 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:15.996534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbbb8-f007-4709-9eaf-4a0ab95fa409 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.996534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbbb8-f007-4709-9eaf-4a0ab95fa409 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.996534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfbbb8-f007-4709-9eaf-4a0ab95fa409 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:15.996534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 91/180] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:15.996534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c50a2-930a-4ca3-9154-a64552940a34 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:15.997020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c50a2-930a-4ca3-9154-a64552940a34 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:15.997020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c50a2-930a-4ca3-9154-a64552940a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.019536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-324c50a2-930a-4ca3-9154-a64552940a34 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:16.021333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-324c50a2-930a-4ca3-9154-a64552940a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:16.067937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:16.070197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:16.089215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:16.093734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 92/181] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:16.094598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c50a2-930a-4ca3-9154-a64552940a34 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.175766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:16.192071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 90/182] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:16.192071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.214521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c50a2-930a-4ca3-9154-a64552940a34 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.253475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d61a05-4292-4430-951c-a1b24c5797f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.254281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d61a05-4292-4430-951c-a1b24c5797f2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.254566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d61a05-4292-4430-951c-a1b24c5797f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.255057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d61a05-4292-4430-951c-a1b24c5797f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.265775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d61a05-4292-4430-951c-a1b24c5797f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d0d61a05-4292-4430-951c-a1b24c5797f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:16.273672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:16.274550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:16.275347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 93/183] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:16.276159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf81676-c2e5-416f-a0d0-db6931d8f87d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.276615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf81676-c2e5-416f-a0d0-db6931d8f87d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.277053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf81676-c2e5-416f-a0d0-db6931d8f87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.296452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2cf81676-c2e5-416f-a0d0-db6931d8f87d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:16.297648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2cf81676-c2e5-416f-a0d0-db6931d8f87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:16.302715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133ae17-5682-4b2c-bf93-45c2588d4b57 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.328374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:16.349845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.350502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.350783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.351056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.351987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] RBAC: Adding query filter params (role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=4e3d837f340948cd83d27b91759a8878) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:16.352563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:16.354019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:16.362461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 91/184] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/role_assignments?user.id=4e3d837f340948cd83d27b91759a8878&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=0f03c426f04e463da379c4eda6247694 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:16.365614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.381954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 94/185] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:16.389406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf81676-c2e5-416f-a0d0-db6931d8f87d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.484332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:16.521311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a32741-1538-4123-a08f-075fe8e9cf34 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.533370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf81676-c2e5-416f-a0d0-db6931d8f87d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.566808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.567787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.568076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.568404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.576073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.577844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.577844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.577844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] PATH_INFO: `/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.578839 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] RBAC: Authorizing `identity:get_project(project_id=9f7f6a964c2f4eac8cda947f6cac7790)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:16.580370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:16.582300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 95/186] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/projects/9f7f6a964c2f4eac8cda947f6cac7790 => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:16.583325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:16.587535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:16.594672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:16.595580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:16.596480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 92/187] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:16.597384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.654268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:16.719171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8ec45-0e78-47bb-9be5-7ceb690212d5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.719719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967a90-be21-495b-96a2-e5ed47a77e9c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.750041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:16.756124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.756820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.757106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.757387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.758128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:16.758434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:16.759881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:16.766354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.767669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.768191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.768672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.769021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 96/188] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:16.769811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.774220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:16.775953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:16.778677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 93/189] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:16.783032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.884616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3577aa7-200c-4949-9f7b-8546ab5e5d96 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.890077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4ebe1-9262-4466-8467-13c83f4e2047 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:16.899051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:16.924123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.924838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.925127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.925410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.926240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=9f7f6a964c2f4eac8cda947f6cac7790, user.id=4e3d837f340948cd83d27b91759a8878) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:16.926560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:16.926751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:16.927429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:16.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:16.927996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:16.928085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:16.928775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:16.929088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:16.930463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:16.934448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 97/190] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/role_assignments?user.id=4e3d837f340948cd83d27b91759a8878&scope.project.id=9f7f6a964c2f4eac8cda947f6cac7790&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:16.939451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 94/191] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:16.952010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:16.952260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:17.028026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:17.092236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78e6cf-1aa8-4d77-94b6-9e3644c5e26d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:17.097464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab0b80-ea18-4ccf-a16f-20443879e536 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:17.137197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:17.138518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:17.138974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:17.139393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] PATH_INFO: `/v3/users/f2d576e833de48e5bd799de6d9bdc22c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:17.140631 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:17.141449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:17.141702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:17.141984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:17.142838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:17.144473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:17.158435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] RBAC: Authorizing `identity:get_user(user_id=f2d576e833de48e5bd799de6d9bdc22c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:17.160230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:17.162652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 98/192] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:16 2022] GET /identity/v3/users/f2d576e833de48e5bd799de6d9bdc22c => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:17.163111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:17.173145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 95/193] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:16 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:17.174276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:17.231403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:17.313823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106175b2-d8ae-4f48-a594-d5b39f86ff02 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:17.333664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:17.341634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff0100-8a1b-419c-b02c-2c3c2b03d999 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:17.364618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:17.365506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:17.366344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:17.366627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] PATH_INFO: `/v3/users/f2d576e833de48e5bd799de6d9bdc22c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:17.368125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2d576e833de48e5bd799de6d9bdc22c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:17.370560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:17.372569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 99/194] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:17 2022] GET /identity/v3/users/f2d576e833de48e5bd799de6d9bdc22c => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:17.378041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:17.383174 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:17.384083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:17.384525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:17.384946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:17.470838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:17.470838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:17.505217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:17.506653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4451f5-df7c-4433-8fa3-5f8dc63debc9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:17.565367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:17.566343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:17.566813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:17.567271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:17.618584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 96/195] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:17.626546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:17.658488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:17.681926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:17.685562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:17.805859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 100/196] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:17.812265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:17.816751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b005ec-c1e7-47a5-8b69-2725e209dc44 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:17.847976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:17.860613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:17.861595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:17.861885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:17.862165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:17.863640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:17.865260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:17.867355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 97/197] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:17 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:17.885676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:17.906115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:17.925775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f165e85-42ba-4899-9d09-c3d6b6e27866 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:17.962582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:17.963790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:17.964311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:17.964981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:17.966520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:17.968229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:17.970192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 101/198] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:17 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:17.978075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:18.066433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88df0b-5b61-48c8-bc7c-ca9b376822da None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:18.106632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453bbd3-61e6-4a0d-ae31-f532a54f115c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:18.116716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b03c3-e986-4f25-9c43-7ae61e60f629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:18.117320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b03c3-e986-4f25-9c43-7ae61e60f629 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:18.117592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b03c3-e986-4f25-9c43-7ae61e60f629 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:18.117869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b03c3-e986-4f25-9c43-7ae61e60f629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:18.118762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b03c3-e986-4f25-9c43-7ae61e60f629 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=f2d576e833de48e5bd799de6d9bdc22c) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:18.119072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b03c3-e986-4f25-9c43-7ae61e60f629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:18.120734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b03c3-e986-4f25-9c43-7ae61e60f629 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:18.127479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 98/199] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:17 2022] GET /identity/v3/role_assignments?user.id=f2d576e833de48e5bd799de6d9bdc22c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:18.136200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291664b-c94a-4f50-8d29-1a4addd892fe None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:18.136200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291664b-c94a-4f50-8d29-1a4addd892fe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:18.136200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291664b-c94a-4f50-8d29-1a4addd892fe None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:18.136200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 99/200] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:18.138434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7da7-4cb4-4e49-ad80-c3d13040b86d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:18.138774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7da7-4cb4-4e49-ad80-c3d13040b86d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:18.139225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf7da7-4cb4-4e49-ad80-c3d13040b86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:18.161843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-67bf7da7-4cb4-4e49-ad80-c3d13040b86d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:18.163062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-67bf7da7-4cb4-4e49-ad80-c3d13040b86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:18.180327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:18.181006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:18.181339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:18.181612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:18.182461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] RBAC: Adding query filter params (role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=f2d576e833de48e5bd799de6d9bdc22c) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:18.182777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:18.184756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:18.197014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 102/201] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:17 2022] GET /identity/v3/role_assignments?user.id=f2d576e833de48e5bd799de6d9bdc22c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=0f03c426f04e463da379c4eda6247694 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:18.284678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:18.288622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 100/202] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:18.309249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:18.329521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:18.427463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96920d2c-42b2-48c4-b424-4f20f0e97172 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:18.463083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:18.463887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:18.464166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:18.464466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:18.476285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:18.484578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:18.485461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:18.486254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 103/203] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:18.491897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7da7-4cb4-4e49-ad80-c3d13040b86d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:18.626128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf7da7-4cb4-4e49-ad80-c3d13040b86d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:18.670269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:18.670941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:18.671218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:18.671489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:18.672269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:18.672579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:18.673966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:18.691713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 101/204] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:18.697098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:18.798972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:18.834891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11fe47-1003-430d-b9f3-4a2d7132d8bc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:18.880045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:18.880972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:18.881252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:18.881525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] PATH_INFO: `/v3/users/60c692234f6b47588ab7adce27a17364` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:18.888191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] RBAC: Authorizing `identity:get_user(user_id=60c692234f6b47588ab7adce27a17364)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:18.889721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:18.891510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 104/205] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:18 2022] GET /identity/v3/users/60c692234f6b47588ab7adce27a17364 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:18.897208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:18.948449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:19.015001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a043f28-1584-46ea-9b6f-dc482590838c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:19.052651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:19.053311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:19.053641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:19.053916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:19.147531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:19.149036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:19.213361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:19.281443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 102/206] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:19.286991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:19.396466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938d5ad-665c-4624-821e-59e2e4c1d89f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:19.444911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1eacc7-a378-4ed9-9e84-03a8e075301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:19.445775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eacc7-a378-4ed9-9e84-03a8e075301f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:19.446057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eacc7-a378-4ed9-9e84-03a8e075301f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:19.446326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1eacc7-a378-4ed9-9e84-03a8e075301f None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:19.447518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eacc7-a378-4ed9-9e84-03a8e075301f None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:19.448988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1eacc7-a378-4ed9-9e84-03a8e075301f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:19.451903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 105/207] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:19 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:19.457783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:19.575262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235bd3d-8f7a-41a3-a299-70ffd905e522 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:19.630252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126aec-60c3-4b08-96fa-5347cdfa0dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:19.630917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126aec-60c3-4b08-96fa-5347cdfa0dab None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:19.631199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126aec-60c3-4b08-96fa-5347cdfa0dab None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:19.631476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126aec-60c3-4b08-96fa-5347cdfa0dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:19.632327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126aec-60c3-4b08-96fa-5347cdfa0dab None admin] RBAC: Adding query filter params (role.id=75eaf9dbf23b401bb28030c3c0d2d561, scope.project.id=e59320347df34780a2d5d9326481f6a6, user.id=60c692234f6b47588ab7adce27a17364) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:19.632641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126aec-60c3-4b08-96fa-5347cdfa0dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:19.634085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126aec-60c3-4b08-96fa-5347cdfa0dab None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:19.644646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 103/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:19 2022] GET /identity/v3/role_assignments?user.id=60c692234f6b47588ab7adce27a17364&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=75eaf9dbf23b401bb28030c3c0d2d561 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:20.248789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2178454-0cc5-410b-b5c8-9d66fcf42b01 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.249186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2178454-0cc5-410b-b5c8-9d66fcf42b01 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.249366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2178454-0cc5-410b-b5c8-9d66fcf42b01 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.251002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 106/209] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:20.256644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52295-7c27-4cf1-b4a3-684c518f02f1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.257117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52295-7c27-4cf1-b4a3-684c518f02f1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.257212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd52295-7c27-4cf1-b4a3-684c518f02f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.282257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-edd52295-7c27-4cf1-b4a3-684c518f02f1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:20.283475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-edd52295-7c27-4cf1-b4a3-684c518f02f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:20.296946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:20.369528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 104/210] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:20.393988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2178454-0cc5-410b-b5c8-9d66fcf42b01 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:20.413553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:20.507958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea646-8f35-48e3-8d6e-2228b1298d87 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.508358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea646-8f35-48e3-8d6e-2228b1298d87 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.508762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea646-8f35-48e3-8d6e-2228b1298d87 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.510249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 105/211] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:20.515891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cbc5d-2589-4010-90b1-da5507b68d3f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.516279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cbc5d-2589-4010-90b1-da5507b68d3f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.516634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cbc5d-2589-4010-90b1-da5507b68d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.518064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2178454-0cc5-410b-b5c8-9d66fcf42b01 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:20.539268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8d5cbc5d-2589-4010-90b1-da5507b68d3f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:20.540672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8d5cbc5d-2589-4010-90b1-da5507b68d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:20.555173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:20.556106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.556429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.556707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.573831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:20.582065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:20.582923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:20.583725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 107/212] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:20.588925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:20.640693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 106/213] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:20.672273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:20.672778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cbc5d-2589-4010-90b1-da5507b68d3f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:20.708462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f312b-84b0-4ec5-8f6a-65355a663bce None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:20.748882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b62e0b-3894-499a-bd6f-6532c809bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:20.749558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62e0b-3894-499a-bd6f-6532c809bc92 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.749844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62e0b-3894-499a-bd6f-6532c809bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.750138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b62e0b-3894-499a-bd6f-6532c809bc92 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.750945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b62e0b-3894-499a-bd6f-6532c809bc92 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:20.751248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b62e0b-3894-499a-bd6f-6532c809bc92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:20.752695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b62e0b-3894-499a-bd6f-6532c809bc92 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:20.756664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:20.763006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 108/214] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:20.764166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6961f8c-a044-48bc-9e08-884dbcc13fb3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.764477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6961f8c-a044-48bc-9e08-884dbcc13fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.764756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6961f8c-a044-48bc-9e08-884dbcc13fb3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.770407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 109/215] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:20.770407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6961f8c-a044-48bc-9e08-884dbcc13fb3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:20.793717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cbc5d-2589-4010-90b1-da5507b68d3f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:20.834937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506d0cd-5927-4942-8830-e6b14113b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:20.835750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d0cd-5927-4942-8830-e6b14113b382 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.836065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d0cd-5927-4942-8830-e6b14113b382 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.836359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506d0cd-5927-4942-8830-e6b14113b382 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.837913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506d0cd-5927-4942-8830-e6b14113b382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:20.839366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506d0cd-5927-4942-8830-e6b14113b382 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:20.841651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 107/216] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:20.842610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22d8f-c454-4a82-8249-3ccec9892429 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.842898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22d8f-c454-4a82-8249-3ccec9892429 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.843178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d22d8f-c454-4a82-8249-3ccec9892429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.861527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-00d22d8f-c454-4a82-8249-3ccec9892429 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:20.862708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-00d22d8f-c454-4a82-8249-3ccec9892429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:20.889934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6961f8c-a044-48bc-9e08-884dbcc13fb3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:20.917608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:20.923338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735136d-c657-4c58-884f-22fc58792f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:20.924222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735136d-c657-4c58-884f-22fc58792f4c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.924501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735136d-c657-4c58-884f-22fc58792f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.925004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735136d-c657-4c58-884f-22fc58792f4c None admin] PATH_INFO: `/v3/users/636c512953ee4ed7a0c1696036c80fe9` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.928973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 108/217] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:20.933039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d22d8f-c454-4a82-8249-3ccec9892429 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:20.939548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735136d-c657-4c58-884f-22fc58792f4c None admin] RBAC: Authorizing `identity:get_user(user_id=636c512953ee4ed7a0c1696036c80fe9)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:20.941028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735136d-c657-4c58-884f-22fc58792f4c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:20.943390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 110/218] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:20 2022] GET /identity/v3/users/636c512953ee4ed7a0c1696036c80fe9 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:20.944574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed23134-17a5-45cb-86f9-cf5400efbe68 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:20.944856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed23134-17a5-45cb-86f9-cf5400efbe68 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:20.945128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed23134-17a5-45cb-86f9-cf5400efbe68 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:20.946470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 111/219] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:20.951061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed23134-17a5-45cb-86f9-cf5400efbe68 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.009446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:21.040804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d22d8f-c454-4a82-8249-3ccec9892429 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.053608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed23134-17a5-45cb-86f9-cf5400efbe68 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.076489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07d0be-9992-40b5-af38-7f255ab712e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.077161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d0be-9992-40b5-af38-7f255ab712e4 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.077439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d0be-9992-40b5-af38-7f255ab712e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.077710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d0be-9992-40b5-af38-7f255ab712e4 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.078416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07d0be-9992-40b5-af38-7f255ab712e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:21.079854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07d0be-9992-40b5-af38-7f255ab712e4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:21.088144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.088826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.089118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.089399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.100698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 109/220] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:20 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:21.109880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099121-e27d-42fc-a228-6f63f0225ade None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.110438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099121-e27d-42fc-a228-6f63f0225ade None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.110875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19099121-e27d-42fc-a228-6f63f0225ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.128420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-19099121-e27d-42fc-a228-6f63f0225ade None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:21.129673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-19099121-e27d-42fc-a228-6f63f0225ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:21.159654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:21.174058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:21.176229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:21.206875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 110/221] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:21.207754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19099121-e27d-42fc-a228-6f63f0225ade None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.279969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:21.306599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 112/222] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:21.307463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.333310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19099121-e27d-42fc-a228-6f63f0225ade None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.382676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.382676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.382676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.382676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.403512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:21.413901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:21.414787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:21.415546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:21.418006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 111/223] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:21.422229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.431302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:21.441785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9748cd4-5790-4788-8fb1-b49b2fd0c523 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.488615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.489686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.489975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.490256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.505860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:21.516777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:21.517682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:21.518664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 113/224] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:21.519523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.547881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94c36-3002-400c-a29e-03e9b5917926 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.567796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:21.588085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.589454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.590061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.590528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.594646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:21.596604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:21.599017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 112/225] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:21.600133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.659532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53845da5-ae44-4ac7-861e-27df5090913f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.711071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.711748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.712035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.712379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.713817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:21.714136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:21.716023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:21.723614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c0ffa-06c0-48e3-819f-4106380b253f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.733347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:21.733347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.749867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:21.769258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.770375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.770849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.771396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.772494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:21.772993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:21.774654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:21.785665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:21.787046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.841490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:21.864167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ec439-632c-4620-b556-d09e2dd5c743 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.903898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00988c07-da54-42b7-9e12-d7ad07508e8f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:21.910125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.910800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.911089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.911367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.912223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=636c512953ee4ed7a0c1696036c80fe9) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:21.913034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:21.914534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:21.922606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/role_assignments?user.id=636c512953ee4ed7a0c1696036c80fe9&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:21.923424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:21.981581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:21.982499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:21.982782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:21.983060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] PATH_INFO: `/v3/users/f2d576e833de48e5bd799de6d9bdc22c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:21.989169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] RBAC: Authorizing `identity:get_user(user_id=f2d576e833de48e5bd799de6d9bdc22c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:21.990683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:21.992492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 114/229] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/users/f2d576e833de48e5bd799de6d9bdc22c => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:21.999829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:22.089248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:22.120502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d958ef-a5b9-4d34-a4c5-54630a54f4c2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:22.154455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da1355-df6b-42c5-9578-8fe54510dc15 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:22.173346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:22.181394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:22.182589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:22.183112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:22.184111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] PATH_INFO: `/v3/users/f2d576e833de48e5bd799de6d9bdc22c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:22.190751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=f2d576e833de48e5bd799de6d9bdc22c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:22.192282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:22.194160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:22.194339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 116/230] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/users/f2d576e833de48e5bd799de6d9bdc22c => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:22.195333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:22.196029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:22.196486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:22.197844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:22.200123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:22.200646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:22.202532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 115/231] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:21 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:22.208504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:22.357036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427279ab-d649-4142-9f82-b084675d3cc3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:22.396000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:22.397119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:22.397579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:22.397998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:22.399399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:22.403518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:22.406562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 117/232] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:22 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:22.413074 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:22.432713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a12ee-7d7a-4c11-94a3-bc5618e91b29 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:22.437893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:22.478435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a60905-c2d1-458a-85b2-b60c953ad9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:22.479357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60905-c2d1-458a-85b2-b60c953ad9d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:22.479640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60905-c2d1-458a-85b2-b60c953ad9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:22.479922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a60905-c2d1-458a-85b2-b60c953ad9d1 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/f2d576e833de48e5bd799de6d9bdc22c/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:22.487056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a60905-c2d1-458a-85b2-b60c953ad9d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=78e22ce2e5004c9eb6f68a72d97dadd3, user_id=f2d576e833de48e5bd799de6d9bdc22c, role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:22.488668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a60905-c2d1-458a-85b2-b60c953ad9d1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:22.510238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 116/233] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:22 2022] PUT /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/f2d576e833de48e5bd799de6d9bdc22c/roles/0f03c426f04e463da379c4eda6247694 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:59:22.535967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d5e0b-0abe-4bf9-8a1a-39840136f930 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:22.574610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f1f48-0d6e-4f7f-851f-465e048824bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:22.576157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f1f48-0d6e-4f7f-851f-465e048824bc None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:22.576675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f1f48-0d6e-4f7f-851f-465e048824bc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:22.577151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f1f48-0d6e-4f7f-851f-465e048824bc None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/f2d576e833de48e5bd799de6d9bdc22c/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:22.579442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f1f48-0d6e-4f7f-851f-465e048824bc None admin] RBAC: Authorizing `identity:create_grant(project_id=78e22ce2e5004c9eb6f68a72d97dadd3, user_id=f2d576e833de48e5bd799de6d9bdc22c, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:22.581117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f1f48-0d6e-4f7f-851f-465e048824bc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:22.599423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 118/234] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:22 2022] PUT /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/f2d576e833de48e5bd799de6d9bdc22c/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:23.674163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cbab1-8aee-4da2-8af9-255f79e2b1ef None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:23.675132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cbab1-8aee-4da2-8af9-255f79e2b1ef None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:23.675613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cbab1-8aee-4da2-8af9-255f79e2b1ef None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:23.677272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 117/235] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:23.683132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d4c4-48a0-48dc-a935-b002aeb05785 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:23.684731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d4c4-48a0-48dc-a935-b002aeb05785 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:23.685213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d4c4-48a0-48dc-a935-b002aeb05785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:23.703720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c054d4c4-48a0-48dc-a935-b002aeb05785 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:23.705387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c054d4c4-48a0-48dc-a935-b002aeb05785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:23.740186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796cea-d23d-4e3a-a62b-683a42433703 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:23.740838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796cea-d23d-4e3a-a62b-683a42433703 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:23.741317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796cea-d23d-4e3a-a62b-683a42433703 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:23.743143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 118/236] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:23.748231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ce838-e90e-47fe-83c5-5a5f3566e36e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:23.748761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ce838-e90e-47fe-83c5-5a5f3566e36e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:23.749240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ce838-e90e-47fe-83c5-5a5f3566e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:23.781069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-029ce838-e90e-47fe-83c5-5a5f3566e36e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:23.782584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-029ce838-e90e-47fe-83c5-5a5f3566e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:23.831534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 119/237] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:23.864625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:23.893318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:23.907504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054d4c4-48a0-48dc-a935-b002aeb05785 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:23.909881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:23.923157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ce838-e90e-47fe-83c5-5a5f3566e36e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:24.077774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ce838-e90e-47fe-83c5-5a5f3566e36e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:24.109799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054d4c4-48a0-48dc-a935-b002aeb05785 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:24.149077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:24.150132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.150422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.150701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.162134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:24.171181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:24.172019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:24.173235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 120/239] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:24.178069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:24.188881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:24.189760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.190052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.190333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.196891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:24.198382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:24.200342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:24.213132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:24.256519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:24.295234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:24.326367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6015d-0c70-406b-988c-b45589282740 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:24.380240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707274-c917-47dc-86d8-faff64375fad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:24.419741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:24.420613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.420905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.421183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.421899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:24.423353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:24.432876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:24.434111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.434398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.434682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.435577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:24.435786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:24.438975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:24.447379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 121/241] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:24.454075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:24.470913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 121/242] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:24 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:24.573478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab80407-25fe-4413-bd3a-7af10fbd4e03 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:24.601865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:24.615987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719a356-b223-4b7f-80dd-2efe4669990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:24.617417 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719a356-b223-4b7f-80dd-2efe4669990a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.617989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719a356-b223-4b7f-80dd-2efe4669990a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.618489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719a356-b223-4b7f-80dd-2efe4669990a None admin] PATH_INFO: `/v3/users/ebee8c7d7b6d4ebdb6632903a7b58372` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.634739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719a356-b223-4b7f-80dd-2efe4669990a None admin] RBAC: Authorizing `identity:get_user(user_id=ebee8c7d7b6d4ebdb6632903a7b58372)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:24.637348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719a356-b223-4b7f-80dd-2efe4669990a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:24.639361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 122/243] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:24 2022] GET /identity/v3/users/ebee8c7d7b6d4ebdb6632903a7b58372 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:24.649378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:24.673762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259469-b6d0-4fb9-9bf3-ebe504765db8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.674452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259469-b6d0-4fb9-9bf3-ebe504765db8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.674907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9259469-b6d0-4fb9-9bf3-ebe504765db8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.676768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 123/244] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:24.685850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2114ef-e501-4c0e-a899-304be2a7b14a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.686461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2114ef-e501-4c0e-a899-304be2a7b14a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.686461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2114ef-e501-4c0e-a899-304be2a7b14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.705554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5d2114ef-e501-4c0e-a899-304be2a7b14a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:24.706842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5d2114ef-e501-4c0e-a899-304be2a7b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:24.791474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 124/245] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:24.818516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2114ef-e501-4c0e-a899-304be2a7b14a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:24.821757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:24.828376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4120b0-a2c9-47d5-b49f-4ab79806a8c5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:24.874536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:24.875160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.875446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.875720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:24.944273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2114ef-e501-4c0e-a899-304be2a7b14a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:24.960672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:24.963941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:24.966291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:24.987705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:24.989246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:24.989761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:24.990229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.003217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:25.015250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:25.016246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:25.017100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 125/246] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:25.022646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.088622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:25.098358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 122/247] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:25.104160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.156471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ae10d-34b4-4076-90ae-2167fdb73fee None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:25.208377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea85c7-c42e-4103-b3b5-e7c23539b904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:25.209024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea85c7-c42e-4103-b3b5-e7c23539b904 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.209311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea85c7-c42e-4103-b3b5-e7c23539b904 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.209588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea85c7-c42e-4103-b3b5-e7c23539b904 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.210359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea85c7-c42e-4103-b3b5-e7c23539b904 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:25.210671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea85c7-c42e-4103-b3b5-e7c23539b904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:25.212112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea85c7-c42e-4103-b3b5-e7c23539b904 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:25.224917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 126/248] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:25.226281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c67f-25f4-4ad8-ad92-ab2f676571b1 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.226510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c67f-25f4-4ad8-ad92-ab2f676571b1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.226788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242c67f-25f4-4ad8-ad92-ab2f676571b1 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.228774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 127/249] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:25.232214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c67f-25f4-4ad8-ad92-ab2f676571b1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.253517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd28d1d-9e77-41ff-a8de-5fbe0ab844bf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:25.280640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:25.298840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d3cdf-ef4d-4e4a-a242-ae9891fbfd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:25.299815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d3cdf-ef4d-4e4a-a242-ae9891fbfd24 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.300234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d3cdf-ef4d-4e4a-a242-ae9891fbfd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.300512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d3cdf-ef4d-4e4a-a242-ae9891fbfd24 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.301692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d3cdf-ef4d-4e4a-a242-ae9891fbfd24 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:25.303280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d3cdf-ef4d-4e4a-a242-ae9891fbfd24 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:25.305742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 123/250] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:25 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:25.306335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e817124-6d29-4fd5-a7da-fd35f49e61f3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.306615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e817124-6d29-4fd5-a7da-fd35f49e61f3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.306885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e817124-6d29-4fd5-a7da-fd35f49e61f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.327290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8e817124-6d29-4fd5-a7da-fd35f49e61f3 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:25.328755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8e817124-6d29-4fd5-a7da-fd35f49e61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:25.373867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242c67f-25f4-4ad8-ad92-ab2f676571b1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:25.414516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:25.423530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d67602-4513-4765-b96e-4f7de2bc1e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:25.424755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67602-4513-4765-b96e-4f7de2bc1e01 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.425370 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 124/251] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:25.425719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67602-4513-4765-b96e-4f7de2bc1e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.426236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d67602-4513-4765-b96e-4f7de2bc1e01 None admin] PATH_INFO: `/v3/users/636c512953ee4ed7a0c1696036c80fe9` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.426526 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5f1a-0662-4928-8b8f-4640d75322cd None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.426814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5f1a-0662-4928-8b8f-4640d75322cd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.427094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5f1a-0662-4928-8b8f-4640d75322cd None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.428342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d67602-4513-4765-b96e-4f7de2bc1e01 None admin] RBAC: Authorizing `identity:get_user(user_id=636c512953ee4ed7a0c1696036c80fe9)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:25.428778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 125/252] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:25.429485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5f1a-0662-4928-8b8f-4640d75322cd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.430453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d67602-4513-4765-b96e-4f7de2bc1e01 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:25.432881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 128/253] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:25 2022] GET /identity/v3/users/636c512953ee4ed7a0c1696036c80fe9 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:25.440669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69642ae7-3122-44a8-a3b9-d6805c75353f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.441243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69642ae7-3122-44a8-a3b9-d6805c75353f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.442161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69642ae7-3122-44a8-a3b9-d6805c75353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.464727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-69642ae7-3122-44a8-a3b9-d6805c75353f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:25.467164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-69642ae7-3122-44a8-a3b9-d6805c75353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:25.558217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 129/254] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:25.559602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69642ae7-3122-44a8-a3b9-d6805c75353f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.560769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5f1a-0662-4928-8b8f-4640d75322cd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:25.606093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:25.621679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:25.622622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.623507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.624315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.625679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] RBAC: Adding query filter params (role.id=75eaf9dbf23b401bb28030c3c0d2d561, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=ebee8c7d7b6d4ebdb6632903a7b58372) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:25.626245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:25.628720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:25.637828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 126/255] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:25 2022] GET /identity/v3/role_assignments?user.id=ebee8c7d7b6d4ebdb6632903a7b58372&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=75eaf9dbf23b401bb28030c3c0d2d561 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:25.644407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.718879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:25.748445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69642ae7-3122-44a8-a3b9-d6805c75353f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:25.783396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0050058-2a2f-4ea9-97c9-af02766f76f2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:25.815643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:25.816647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.816928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.817318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.820949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:25.822367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:25.822833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:25.823330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:25.823683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:25.824161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:25.825452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 130/256] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:25 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:25.826270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.835996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:25.846323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:25.847534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:25.848346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:25.848961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 127/257] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:25.849339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:25.970490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:25.974493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbbb1c-f164-4b49-8c25-2ae3f074ab39 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.014103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:26.015326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:26.015791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:26.016271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:26.038550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:26.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:26.055202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:26.055983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:26.060257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 131/258] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:26.063399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:26.075821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1246ab4-87da-4c38-a3b2-ac1b0c865bcd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.114978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:26.148867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:26.149771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:26.150049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:26.150323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/636c512953ee4ed7a0c1696036c80fe9/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:26.152527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] RBAC: Authorizing `identity:create_grant(project_id=78e22ce2e5004c9eb6f68a72d97dadd3, user_id=636c512953ee4ed7a0c1696036c80fe9, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:26.153883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:26.194389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 128/259] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:25 2022] PUT /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/636c512953ee4ed7a0c1696036c80fe9/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:26.195672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:26.209024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd71c-19a0-4d04-aab4-f55894186989 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.248618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:26.249824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:26.250251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:26.250668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:26.251584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:26.252035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:26.253673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:26.266458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 132/260] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:26.272682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:26.324990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:26.416012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f3769-211e-45c3-9f7f-84368f4bd359 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.471091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9933df04-1da6-43d6-916e-82114527c0a0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.477261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:26.479059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:26.479527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:26.484786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:26.485776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:26.486238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:26.487800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:26.502471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 129/261] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:26.508392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:26.543414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:26.544619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:26.545265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:26.546978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] PATH_INFO: `/v3/users/f2d576e833de48e5bd799de6d9bdc22c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:26.549953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] RBAC: Authorizing `identity:get_user(user_id=f2d576e833de48e5bd799de6d9bdc22c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:26.551799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:26.555745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 133/262] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:26 2022] GET /identity/v3/users/f2d576e833de48e5bd799de6d9bdc22c => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:26.567385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:26.590155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:26.710001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:26.710413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4e64f-57bd-4fe3-af65-314b6b1d848d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.717258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d27f9-07ca-4857-8d20-afd75960c9dd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.774247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:26.774856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:26.775101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:26.775381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:26.800896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:26.801808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:26.802094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:26.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] PATH_INFO: `/v3/users/f2d576e833de48e5bd799de6d9bdc22c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:26.803631 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] RBAC: Authorizing `identity:get_user(user_id=f2d576e833de48e5bd799de6d9bdc22c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:26.805118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:26.806776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 130/263] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:26 2022] GET /identity/v3/users/f2d576e833de48e5bd799de6d9bdc22c => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:26.813173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:26.889642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:26.891318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:26.952709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b432708-dd13-41a9-b0dd-ceea30d20cb5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:26.963865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:27.022959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:27.023627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:27.023914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:27.024209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:27.045053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:27.071711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 134/264] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:27.078629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:27.201248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:27.202730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:27.316060 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24356f2-fdea-4452-a0c7-6336e9b97f17 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:27.384258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:27.385130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:27.385411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:27.385688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:27.388753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:27.390216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:27.391928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 135/265] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:27 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:27.399592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:27.414139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 131/266] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:27.421195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:27.437475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:27.513489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:27.600201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f8309-1e7c-44d7-82c6-741a0a2e2d1b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:27.606384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c86cec-afb5-4f32-b766-42f8ada997a9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:27.677331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:27.678549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:27.679090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:27.679550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:27.680984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa44bf-8d83-4613-8a5b-a6e320cf0999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:27.681364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:27.681653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa44bf-8d83-4613-8a5b-a6e320cf0999 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:27.681938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa44bf-8d83-4613-8a5b-a6e320cf0999 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:27.682215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa44bf-8d83-4613-8a5b-a6e320cf0999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:27.683057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa44bf-8d83-4613-8a5b-a6e320cf0999 None admin] RBAC: Adding query filter params (role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=f2d576e833de48e5bd799de6d9bdc22c) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:27.683760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa44bf-8d83-4613-8a5b-a6e320cf0999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:27.684135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:27.685258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa44bf-8d83-4613-8a5b-a6e320cf0999 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:27.691765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 132/267] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:27 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:27.693577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:27.710782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 136/268] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:27 2022] GET /identity/v3/role_assignments?user.id=f2d576e833de48e5bd799de6d9bdc22c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=0f03c426f04e463da379c4eda6247694 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:27.742777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9897-bf97-4a5c-8667-130e5253adad None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:27.743095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9897-bf97-4a5c-8667-130e5253adad None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:27.743338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce9897-bf97-4a5c-8667-130e5253adad None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:27.744999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 137/269] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:59:27.763703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66876b-3885-4a15-8a81-22874ff829cf None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:27.764012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66876b-3885-4a15-8a81-22874ff829cf None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:27.764281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66876b-3885-4a15-8a81-22874ff829cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:27.796742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2b66876b-3885-4a15-8a81-22874ff829cf None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:27.797976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2b66876b-3885-4a15-8a81-22874ff829cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:27.836796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:27.876862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2d3e6-527d-4f77-937d-8c0f6d25536c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:27.942276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:27.942950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:27.943230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:27.943502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:27.948331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 138/270] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:27.949305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=f2d576e833de48e5bd799de6d9bdc22c) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:27.949836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:27.951414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:27.961295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 133/271] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:27 2022] GET /identity/v3/role_assignments?user.id=f2d576e833de48e5bd799de6d9bdc22c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:27.978601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66876b-3885-4a15-8a81-22874ff829cf None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:28.041100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:28.110582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66876b-3885-4a15-8a81-22874ff829cf None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:28.158699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b084f1-2f15-41df-9d0d-3570755f435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:28.159499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b084f1-2f15-41df-9d0d-3570755f435b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.159789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b084f1-2f15-41df-9d0d-3570755f435b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.160062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b084f1-2f15-41df-9d0d-3570755f435b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.179893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b084f1-2f15-41df-9d0d-3570755f435b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-56b084f1-2f15-41df-9d0d-3570755f435b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:28.189099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:28.190038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:28.190815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 139/272] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:28.200092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:28.303424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707f2b-ab21-4483-97ca-73421a5fd134 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.304067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707f2b-ab21-4483-97ca-73421a5fd134 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.304700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f707f2b-ab21-4483-97ca-73421a5fd134 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.306288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 140/273] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:28.312840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb82a1-d03d-453f-9ca6-a0b4222388ef None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.313223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb82a1-d03d-453f-9ca6-a0b4222388ef None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.313718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb82a1-d03d-453f-9ca6-a0b4222388ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.328404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a22c810-8db9-496e-a64d-d06c3d83e35b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:28.353208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5bcb82a1-d03d-453f-9ca6-a0b4222388ef None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:28.354422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5bcb82a1-d03d-453f-9ca6-a0b4222388ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:28.380515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:28.381517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.381981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.382433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.383360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:28.383837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:28.385428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:28.396208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 134/274] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:28.407615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:28.413010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:28.449796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 141/275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:28.482421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb82a1-d03d-453f-9ca6-a0b4222388ef None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:28.533580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:28.548683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f852f-a948-48ed-aeac-b9b37f0076df None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:28.583961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925ac9e-97eb-4db9-9e6c-baeb43abdce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:28.584866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ac9e-97eb-4db9-9e6c-baeb43abdce7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.585148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ac9e-97eb-4db9-9e6c-baeb43abdce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.585418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925ac9e-97eb-4db9-9e6c-baeb43abdce7 None admin] PATH_INFO: `/v3/users/e0ff5314a4c44d04971af782eb7fe564` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.595788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb82a1-d03d-453f-9ca6-a0b4222388ef None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:28.609119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ac9e-97eb-4db9-9e6c-baeb43abdce7 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ff5314a4c44d04971af782eb7fe564)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:28.610593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925ac9e-97eb-4db9-9e6c-baeb43abdce7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:28.612427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 135/276] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:28 2022] GET /identity/v3/users/e0ff5314a4c44d04971af782eb7fe564 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:28.618467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c87d35-9c26-4282-8449-77f9ac1f0217 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.618647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c87d35-9c26-4282-8449-77f9ac1f0217 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.618928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c87d35-9c26-4282-8449-77f9ac1f0217 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.620419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 136/277] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:28.621711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c87d35-9c26-4282-8449-77f9ac1f0217 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:28.632546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab30c87-9aa1-4d5a-863a-3d61e74bc055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:28.633344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30c87-9aa1-4d5a-863a-3d61e74bc055 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.633626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30c87-9aa1-4d5a-863a-3d61e74bc055 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.633898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab30c87-9aa1-4d5a-863a-3d61e74bc055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.635442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab30c87-9aa1-4d5a-863a-3d61e74bc055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:28.638131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab30c87-9aa1-4d5a-863a-3d61e74bc055 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:28.640086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 142/278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:28.645631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743204b-d73b-40d4-834e-d4d72e8b7ab6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.646033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743204b-d73b-40d4-834e-d4d72e8b7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.646336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743204b-d73b-40d4-834e-d4d72e8b7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.663765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1743204b-d73b-40d4-834e-d4d72e8b7ab6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:28.664991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1743204b-d73b-40d4-834e-d4d72e8b7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:28.690437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:28.734587 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c87d35-9c26-4282-8449-77f9ac1f0217 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:28.738166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 143/279] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:28.745809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743204b-d73b-40d4-834e-d4d72e8b7ab6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:28.773829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:28.774492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.774776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.775118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.775945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, user.id=e0ff5314a4c44d04971af782eb7fe564, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:28.776291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:28.778306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:28.783493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 137/280] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 16 20:59:28 2022] GET /identity/v3/role_assignments?user.id=e0ff5314a4c44d04971af782eb7fe564&scope.system=all&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:28.784310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:28.812385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:28.889791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743204b-d73b-40d4-834e-d4d72e8b7ab6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:28.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dafe6-120a-4ccb-8f92-37f290f87c4a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:28.931463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:28.932426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.932855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.933413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.934295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:28.936161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:28.957191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:28.959118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 144/281] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:28 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:28.968292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:28.969815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:28.970245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:28.970670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:28.984821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:28.993923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:28.994873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:28.995671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:28.998367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 138/282] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:29.004809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:29.135768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:29.143022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75280b8f-6c35-4334-98d0-ec1752c25147 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:29.185584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd39bf-d0b7-400c-8253-24ed2c1475dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:29.186402 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd39bf-d0b7-400c-8253-24ed2c1475dd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:29.186891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd39bf-d0b7-400c-8253-24ed2c1475dd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:29.187468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd39bf-d0b7-400c-8253-24ed2c1475dd None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:29.188797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd39bf-d0b7-400c-8253-24ed2c1475dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:29.189118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd39bf-d0b7-400c-8253-24ed2c1475dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:29.190858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd39bf-d0b7-400c-8253-24ed2c1475dd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:29.202090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 145/283] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:29.209233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:29.300712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d2b0-4ba1-40ce-8c8d-a2a14bc41ed4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:29.301343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d2b0-4ba1-40ce-8c8d-a2a14bc41ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:29.301824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59d2b0-4ba1-40ce-8c8d-a2a14bc41ed4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:29.303690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 146/284] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:59:29.312147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d122d-64c0-4882-8c8f-2c1348eb1c64 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:29.312774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d122d-64c0-4882-8c8f-2c1348eb1c64 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:29.313280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d122d-64c0-4882-8c8f-2c1348eb1c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:29.342297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-038d122d-64c0-4882-8c8f-2c1348eb1c64 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:29.343852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-038d122d-64c0-4882-8c8f-2c1348eb1c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:29.353427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71377b-b887-444c-86aa-bf587ec80f84 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:29.404386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:29.405293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:29.405578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:29.405855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] PATH_INFO: `/v3/users/ebee8c7d7b6d4ebdb6632903a7b58372` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:29.407690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] RBAC: Authorizing `identity:get_user(user_id=ebee8c7d7b6d4ebdb6632903a7b58372)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:29.409921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:29.412209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 139/285] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:29 2022] GET /identity/v3/users/ebee8c7d7b6d4ebdb6632903a7b58372 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:29.419300 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:29.451374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 147/286] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:29.487067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d122d-64c0-4882-8c8f-2c1348eb1c64 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:29.505393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:29.600610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a8851-e906-4b1e-b82c-6a85ed06fdc7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:29.651875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:29.653314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:29.653599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:29.653970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:29.656966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:29.659230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:29.661505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 140/287] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:29 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:29.682922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:29.712817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:29.744868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d122d-64c0-4882-8c8f-2c1348eb1c64 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:29.822274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:29.823089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:29.823376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:29.823653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:29.851858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:29.871571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:29.872568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:29.873344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:29.874663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 148/288] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:29.882336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:29.915133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b04fd-3eab-480e-9822-6cb61616b8d9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:29.974132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:30.009870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:30.010783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:30.011071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:30.011399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/ebee8c7d7b6d4ebdb6632903a7b58372/roles/75eaf9dbf23b401bb28030c3c0d2d561` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:30.014356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=78e22ce2e5004c9eb6f68a72d97dadd3, user_id=ebee8c7d7b6d4ebdb6632903a7b58372, role_id=75eaf9dbf23b401bb28030c3c0d2d561)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:30.015826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:30.040914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 141/289] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 20:59:29 2022] PUT /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/users/ebee8c7d7b6d4ebdb6632903a7b58372/roles/75eaf9dbf23b401bb28030c3c0d2d561 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:30.081793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b1901-6820-47fd-b6c0-6ac0f7f94711 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:30.141552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:30.142261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:30.142550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:30.142896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:30.143695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:30.144084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:30.145643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:30.157593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 149/290] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:30.166103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:30.317459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443dabc-ce11-475a-86cf-179f1188f8a5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:30.362950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:30.363890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:30.364199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:30.364490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] PATH_INFO: `/v3/users/636c512953ee4ed7a0c1696036c80fe9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:30.365717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] RBAC: Authorizing `identity:get_user(user_id=636c512953ee4ed7a0c1696036c80fe9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:30.367170 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:30.369104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 142/291] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:30 2022] GET /identity/v3/users/636c512953ee4ed7a0c1696036c80fe9 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:30.376039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:30.390575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:30.501037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a603d-a2e8-4e76-bb13-b7af78743ac1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:30.550606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:30.551566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:30.552111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:30.552590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:30.654628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:30.656488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:30.668912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:30.787030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 150/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:59:30.788754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:30.842138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:30.898982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20235094-4223-4e34-8fd6-02f667d5468e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:30.943089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74c00b-9662-40eb-acdf-78e16f796e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:30.944355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c00b-9662-40eb-acdf-78e16f796e5a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:30.944863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c00b-9662-40eb-acdf-78e16f796e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:30.945341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74c00b-9662-40eb-acdf-78e16f796e5a None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:30.952676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74c00b-9662-40eb-acdf-78e16f796e5a None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:30.954404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74c00b-9662-40eb-acdf-78e16f796e5a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:30.956391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 143/293] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:30 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:30.962741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:31.077525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd2c6c-114a-464b-b039-f55ad0a3b198 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:31.088457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:31.126248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f20a1b-6a2f-4d8e-a737-d69710ff7207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:31.126915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f20a1b-6a2f-4d8e-a737-d69710ff7207 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:31.127200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f20a1b-6a2f-4d8e-a737-d69710ff7207 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:31.127478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f20a1b-6a2f-4d8e-a737-d69710ff7207 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:31.128341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f20a1b-6a2f-4d8e-a737-d69710ff7207 None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=636c512953ee4ed7a0c1696036c80fe9) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:31.128659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f20a1b-6a2f-4d8e-a737-d69710ff7207 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:31.130103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f20a1b-6a2f-4d8e-a737-d69710ff7207 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:31.137302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 151/294] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:30 2022] GET /identity/v3/role_assignments?user.id=636c512953ee4ed7a0c1696036c80fe9&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:31.654089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe75b9-08f0-43d7-994d-ea031c5c3699 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:31.655090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe75b9-08f0-43d7-994d-ea031c5c3699 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:31.655595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe75b9-08f0-43d7-994d-ea031c5c3699 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:31.657642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 144/295] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:31.665283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5314d9-c21d-47e3-bbcf-c1fdbef324ba None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:31.665919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5314d9-c21d-47e3-bbcf-c1fdbef324ba None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:31.666402 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5314d9-c21d-47e3-bbcf-c1fdbef324ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:31.685039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cd5314d9-c21d-47e3-bbcf-c1fdbef324ba None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:31.686593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cd5314d9-c21d-47e3-bbcf-c1fdbef324ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:31.721018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9738e-ca5b-4e8a-80b6-ae6aa4a6cdcc None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:31.721665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9738e-ca5b-4e8a-80b6-ae6aa4a6cdcc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:31.722149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9738e-ca5b-4e8a-80b6-ae6aa4a6cdcc None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:31.723994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 145/296] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:31.743712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9486d10-4e18-40cc-abeb-dabd14f1ba3a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:31.744348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9486d10-4e18-40cc-abeb-dabd14f1ba3a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:31.744832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9486d10-4e18-40cc-abeb-dabd14f1ba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:31.771220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e9486d10-4e18-40cc-abeb-dabd14f1ba3a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:31.772467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e9486d10-4e18-40cc-abeb-dabd14f1ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:31.778035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 152/297] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:31.801125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5314d9-c21d-47e3-bbcf-c1fdbef324ba None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:31.860346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 146/298] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:31.886893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9486d10-4e18-40cc-abeb-dabd14f1ba3a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:31.916991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5314d9-c21d-47e3-bbcf-c1fdbef324ba None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:31.920696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:31.939787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:31.954695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98735f4-10b6-47ad-bd15-5e5de9a305dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:31.955753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98735f4-10b6-47ad-bd15-5e5de9a305dc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:31.956099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98735f4-10b6-47ad-bd15-5e5de9a305dc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:31.956407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98735f4-10b6-47ad-bd15-5e5de9a305dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:31.967671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98735f4-10b6-47ad-bd15-5e5de9a305dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d98735f4-10b6-47ad-bd15-5e5de9a305dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:31.975734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:31.976733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:31.977552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 153/299] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:31.978189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2f62-24d3-4d3f-94e2-6766b0cb00c0 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:31.978427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2f62-24d3-4d3f-94e2-6766b0cb00c0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:31.978702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d2f62-24d3-4d3f-94e2-6766b0cb00c0 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:31.980116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 154/300] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:31.985023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d2f62-24d3-4d3f-94e2-6766b0cb00c0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.001871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9486d10-4e18-40cc-abeb-dabd14f1ba3a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.041285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a016-5875-434a-9380-eb99fee85eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.042515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a016-5875-434a-9380-eb99fee85eda None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.043382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a016-5875-434a-9380-eb99fee85eda None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.043958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a016-5875-434a-9380-eb99fee85eda None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.045298 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a016-5875-434a-9380-eb99fee85eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:32.047384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a016-5875-434a-9380-eb99fee85eda None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:32.049877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 147/301] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:32.050944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1b98-0e8d-4e85-8e6d-f6585771ce3d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.051231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1b98-0e8d-4e85-8e6d-f6585771ce3d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.051507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1b98-0e8d-4e85-8e6d-f6585771ce3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.071097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-814f1b98-0e8d-4e85-8e6d-f6585771ce3d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:32.072673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-814f1b98-0e8d-4e85-8e6d-f6585771ce3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:32.098628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d2f62-24d3-4d3f-94e2-6766b0cb00c0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.132616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.133212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.133496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.135448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.135448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:32.135448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:32.137968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:32.146835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 155/302] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:32.147641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.152729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 148/303] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:32.154048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1b98-0e8d-4e85-8e6d-f6585771ce3d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.181420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:32.207308 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:32.263824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1b98-0e8d-4e85-8e6d-f6585771ce3d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.264016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2488252-8c96-4192-a264-8bbbfddd3696 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.299949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.300646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.300930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.301207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] PATH_INFO: `/v3/groups` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.301887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:32.302848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.303320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:32.303725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.304003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.304296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] PATH_INFO: `/v3/users/e0ff5314a4c44d04971af782eb7fe564` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.305481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] RBAC: Authorizing `identity:get_user(user_id=e0ff5314a4c44d04971af782eb7fe564)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:32.306907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:32.309492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 149/304] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:32 2022] GET /identity/v3/users/e0ff5314a4c44d04971af782eb7fe564 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:32.313106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.320547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 156/305] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Jun 16 20:59:32 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:32.321592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.416756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:32.434272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc48273-6683-404f-87f0-adfe3ac99e8e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.469844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e25c3-936b-447e-9fba-08434c1e2a7c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.476702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.477595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.477881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.478160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] PATH_INFO: `/v3/system/users/e0ff5314a4c44d04971af782eb7fe564/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.479823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e0ff5314a4c44d04971af782eb7fe564, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:32.482720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:32.495660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 157/306] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Jun 16 20:59:32 2022] PUT /identity/v3/system/users/e0ff5314a4c44d04971af782eb7fe564/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:32.504640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:32.524957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5163e-1eee-4812-841d-08a4fe1984b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.525872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5163e-1eee-4812-841d-08a4fe1984b6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.526160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5163e-1eee-4812-841d-08a4fe1984b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.526508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5163e-1eee-4812-841d-08a4fe1984b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.539698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5163e-1eee-4812-841d-08a4fe1984b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e1d5163e-1eee-4812-841d-08a4fe1984b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:32.548460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:32.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:32.550210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 150/307] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:32.566460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.707125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff0309-db9f-43b0-8a31-a2a4b2f2faac None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.718281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8471f-7cdf-4750-86f9-826282b8e451 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.718771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8471f-7cdf-4750-86f9-826282b8e451 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.718844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8471f-7cdf-4750-86f9-826282b8e451 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.720380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 151/308] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:59:32.725708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217af3-1df4-492d-a41b-606ff0b06765 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.726007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217af3-1df4-492d-a41b-606ff0b06765 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.726291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27217af3-1df4-492d-a41b-606ff0b06765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.746521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-27217af3-1df4-492d-a41b-606ff0b06765 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:32.746817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.747417 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.747708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.747809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27217af3-1df4-492d-a41b-606ff0b06765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:32.747981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.748768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:32.749077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:32.750717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:32.761587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 158/309] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:32.766993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.786597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:32.839270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 152/310] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:32.863161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217af3-1df4-492d-a41b-606ff0b06765 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.888997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b0ccf9-d8cc-4607-a073-2dd5415d3ba4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.925703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:32.926725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:32.927018 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:32.927300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] PATH_INFO: `/v3/users/1082b4f9f15e4107a556ee535a8b7e9d` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:32.941793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] RBAC: Authorizing `identity:get_user(user_id=1082b4f9f15e4107a556ee535a8b7e9d)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:32.943475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:32.950582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 159/311] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:32 2022] GET /identity/v3/users/1082b4f9f15e4107a556ee535a8b7e9d => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:32.951700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:32.981510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27217af3-1df4-492d-a41b-606ff0b06765 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:32.984583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:33.032872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:33.035089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:33.036130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:33.036491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:33.036704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:33.052620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:33.064216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:33.065118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:33.065902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:33.069057 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 153/312] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:33.076224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad896c92-b34b-406e-8e23-839eea674e09 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:33.077144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:33.114368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:33.115009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:33.115300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:33.115579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:33.116444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] RBAC: Adding query filter params (role.id=75eaf9dbf23b401bb28030c3c0d2d561, user.id=1082b4f9f15e4107a556ee535a8b7e9d, scope.system=all) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:33.116758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:33.118204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:33.124200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 160/313] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 16 20:59:32 2022] GET /identity/v3/role_assignments?user.id=1082b4f9f15e4107a556ee535a8b7e9d&scope.system=all&role.id=75eaf9dbf23b401bb28030c3c0d2d561 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:33.200134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765f8c-8823-4ce3-a3c1-1f4ad9d80ffa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:33.239039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:33.239638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:33.239923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:33.240225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:33.240991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:33.241303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:33.242708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:33.253101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 154/314] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:33.258779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:33.367840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf67079-b701-42e8-b0a4-284b3d67b7d3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:33.404263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:33.405150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:33.405434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:33.405712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] PATH_INFO: `/v3/users/ebee8c7d7b6d4ebdb6632903a7b58372` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:33.406915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] RBAC: Authorizing `identity:get_user(user_id=ebee8c7d7b6d4ebdb6632903a7b58372)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:33.408386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:33.410230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 161/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:33 2022] GET /identity/v3/users/ebee8c7d7b6d4ebdb6632903a7b58372 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:33.415547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:33.444912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:33.524552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cff62-6fc0-4a66-a2e1-46e3836eb72d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:33.562540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:33.563197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:33.563480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:33.563756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:33.640588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:33.642068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:33.672696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:33.748610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 155/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:33.753919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:33.756831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:33.860748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fceb52-aa80-41fc-9032-eeb792af4cfd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:33.896346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d1769-75b3-423a-8200-dfd8e1c706de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:33.897628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d1769-75b3-423a-8200-dfd8e1c706de None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:33.898124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d1769-75b3-423a-8200-dfd8e1c706de None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:33.898608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d1769-75b3-423a-8200-dfd8e1c706de None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:33.899990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d1769-75b3-423a-8200-dfd8e1c706de None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:33.901646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d1769-75b3-423a-8200-dfd8e1c706de None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:33.904750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 162/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:33 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:33.910816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:34.012943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c9703-5ae9-4e00-9559-eff3c143d722 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:34.039391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:34.048542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec50a63-49fd-43df-9e11-38acd67ad5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:34.049331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec50a63-49fd-43df-9e11-38acd67ad5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:34.050016 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec50a63-49fd-43df-9e11-38acd67ad5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:34.050649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec50a63-49fd-43df-9e11-38acd67ad5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:34.051491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec50a63-49fd-43df-9e11-38acd67ad5c4 None admin] RBAC: Adding query filter params (role.id=75eaf9dbf23b401bb28030c3c0d2d561, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3, user.id=ebee8c7d7b6d4ebdb6632903a7b58372) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:34.052331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec50a63-49fd-43df-9e11-38acd67ad5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:34.053845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec50a63-49fd-43df-9e11-38acd67ad5c4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:34.060827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 156/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 20:59:33 2022] GET /identity/v3/role_assignments?user.id=ebee8c7d7b6d4ebdb6632903a7b58372&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=75eaf9dbf23b401bb28030c3c0d2d561 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:34.586337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbac34-602b-4ea1-af21-dac1440f8b01 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:34.586856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbac34-602b-4ea1-af21-dac1440f8b01 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:34.586961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbac34-602b-4ea1-af21-dac1440f8b01 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:34.588304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 163/319] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:34.595376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b660a-c3bb-4755-b620-7e1002592ac5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:34.595666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b660a-c3bb-4755-b620-7e1002592ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:34.595941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b660a-c3bb-4755-b620-7e1002592ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:34.615422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-650b660a-c3bb-4755-b620-7e1002592ac5 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:34.616628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-650b660a-c3bb-4755-b620-7e1002592ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:34.692364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 157/320] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:34.712928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbac34-602b-4ea1-af21-dac1440f8b01 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:34.739245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976fbd-610c-48e7-bf19-9efad8df3d4a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:34.739542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976fbd-610c-48e7-bf19-9efad8df3d4a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:34.739826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22976fbd-610c-48e7-bf19-9efad8df3d4a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:34.741375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 158/321] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:34.746549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e733ea-aed1-4d3d-b7c9-0edd55fc67d2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:34.746903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e733ea-aed1-4d3d-b7c9-0edd55fc67d2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:34.747295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e733ea-aed1-4d3d-b7c9-0edd55fc67d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:34.763654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b6e733ea-aed1-4d3d-b7c9-0edd55fc67d2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:34.764875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b6e733ea-aed1-4d3d-b7c9-0edd55fc67d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:34.785492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:34.820574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbac34-602b-4ea1-af21-dac1440f8b01 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:34.834756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 159/322] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:34.857411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:34.857954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:34.858243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:34.858337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e733ea-aed1-4d3d-b7c9-0edd55fc67d2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:34.858521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:34.859687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:34.861172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:34.862921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 164/323] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:34.869424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:34.908859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:34.960691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e733ea-aed1-4d3d-b7c9-0edd55fc67d2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:34.979404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e0f1c-4003-457a-a25f-42f6106148fc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:35.000233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:35.001035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.001739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.002027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.014561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:35.015971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:35.016675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.016962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.017240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] PATH_INFO: `/v3/groups` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.017930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:35.019379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:35.022588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:35.023436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:35.024240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 160/324] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:35.029770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:35.032095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:35.043053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 165/325] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Jun 16 20:59:34 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:59:35.141878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe7361-ee9f-4dc8-8454-0974505903eb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:35.153795 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:35.180443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:35.181127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.181410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.181690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.182447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:35.182757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:35.184361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:35.198544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 161/326] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:35.199893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:35.307553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f795adb-c55c-4e7e-8a5f-ac3450c98913 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:35.350424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a66e-4b87-413a-8d68-0e60067e1616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:35.351319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a66e-4b87-413a-8d68-0e60067e1616 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.351603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a66e-4b87-413a-8d68-0e60067e1616 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.351870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a66e-4b87-413a-8d68-0e60067e1616 None admin] PATH_INFO: `/v3/users/e0ff5314a4c44d04971af782eb7fe564` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.353194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a66e-4b87-413a-8d68-0e60067e1616 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ff5314a4c44d04971af782eb7fe564)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:35.354670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a66e-4b87-413a-8d68-0e60067e1616 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:35.357118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 166/327] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:35 2022] GET /identity/v3/users/e0ff5314a4c44d04971af782eb7fe564 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:35.362813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:35.390964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7ddb-3650-4e26-bb86-2873826974f9 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.391592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7ddb-3650-4e26-bb86-2873826974f9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.391864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b7ddb-3650-4e26-bb86-2873826974f9 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.393321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 167/328] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:35.398877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505ef1e-e182-495d-b559-702079aabfa0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.399155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505ef1e-e182-495d-b559-702079aabfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.399427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505ef1e-e182-495d-b559-702079aabfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.420984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e505ef1e-e182-495d-b559-702079aabfa0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:35.422721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e505ef1e-e182-495d-b559-702079aabfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:35.492680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445db401-0446-417b-8e00-2a8321fc8a1c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:35.502948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:35.514390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 168/329] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:35.534097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:35.535090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.535607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.536071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.537188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] RBAC: Adding query filter params (role.id=9aa8f94e3f1446a788810d3425df2ccf, user.id=e0ff5314a4c44d04971af782eb7fe564, scope.system=all) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:35.537696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:35.538010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505ef1e-e182-495d-b559-702079aabfa0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:35.539559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:35.554484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 162/330] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 16 20:59:35 2022] GET /identity/v3/role_assignments?user.id=e0ff5314a4c44d04971af782eb7fe564&scope.system=all&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:35.660981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505ef1e-e182-495d-b559-702079aabfa0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:35.705364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:35.706245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.706531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.706807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.719627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:35.728132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:35.729107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:35.729898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 169/331] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:35.736591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:35.772470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:35.850470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526e697-2e91-496a-bcdf-be3b267a8550 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:35.893375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:35.894424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:35.894903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:35.895372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:35.896337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:35.896839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:35.898418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:35.910455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 163/332] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:35.916258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:35.977323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:36.024165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4426d6-c465-4e45-8c2c-f0f9336c941d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:36.059789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a10f18-0a93-4a71-8325-748ec1260848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:36.060765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10f18-0a93-4a71-8325-748ec1260848 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:36.060991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10f18-0a93-4a71-8325-748ec1260848 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:36.061304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a10f18-0a93-4a71-8325-748ec1260848 None admin] PATH_INFO: `/v3/users/1082b4f9f15e4107a556ee535a8b7e9d` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:36.062547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a10f18-0a93-4a71-8325-748ec1260848 None admin] RBAC: Authorizing `identity:get_user(user_id=1082b4f9f15e4107a556ee535a8b7e9d)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:36.064009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a10f18-0a93-4a71-8325-748ec1260848 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:36.065696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 170/333] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:35 2022] GET /identity/v3/users/1082b4f9f15e4107a556ee535a8b7e9d => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:36.071374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:36.172651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:36.179306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01781ff4-1457-476f-9c96-89229dc943a7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:36.215013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db76698-9fa5-4d53-ae89-5f6add0e4c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:36.215893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db76698-9fa5-4d53-ae89-5f6add0e4c9e None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:36.216202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db76698-9fa5-4d53-ae89-5f6add0e4c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:36.216482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db76698-9fa5-4d53-ae89-5f6add0e4c9e None admin] PATH_INFO: `/v3/system/users/1082b4f9f15e4107a556ee535a8b7e9d/roles/75eaf9dbf23b401bb28030c3c0d2d561` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:36.218047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db76698-9fa5-4d53-ae89-5f6add0e4c9e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1082b4f9f15e4107a556ee535a8b7e9d, role_id=75eaf9dbf23b401bb28030c3c0d2d561)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:36.219471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db76698-9fa5-4d53-ae89-5f6add0e4c9e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:36.233138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 164/334] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Jun 16 20:59:36 2022] PUT /identity/v3/system/users/1082b4f9f15e4107a556ee535a8b7e9d/roles/75eaf9dbf23b401bb28030c3c0d2d561 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:37.591107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc3b0-a301-4b18-a45e-2decf9eb4b47 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:37.591712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc3b0-a301-4b18-a45e-2decf9eb4b47 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:37.591712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017dc3b0-a301-4b18-a45e-2decf9eb4b47 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:37.593380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 171/335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:37.599352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b41fda-5780-4e4f-9782-3f4337206ec1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:37.599827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b41fda-5780-4e4f-9782-3f4337206ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:37.599908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b41fda-5780-4e4f-9782-3f4337206ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:37.621224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b2b41fda-5780-4e4f-9782-3f4337206ec1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:37.622439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b2b41fda-5780-4e4f-9782-3f4337206ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:37.704479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 165/336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:37.752530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dc3b0-a301-4b18-a45e-2decf9eb4b47 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:37.855414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef532e2f-54fc-46b7-8776-cddb36c9f4aa None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:37.855655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef532e2f-54fc-46b7-8776-cddb36c9f4aa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:37.855903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef532e2f-54fc-46b7-8776-cddb36c9f4aa None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:37.857290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 166/337] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:59:37.874135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017dc3b0-a301-4b18-a45e-2decf9eb4b47 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:37.877457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db6c1a-3425-4c13-b5ea-60a0b0a223d8 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:37.877988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db6c1a-3425-4c13-b5ea-60a0b0a223d8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:37.878491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db6c1a-3425-4c13-b5ea-60a0b0a223d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:37.904979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-71db6c1a-3425-4c13-b5ea-60a0b0a223d8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:37.906533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-71db6c1a-3425-4c13-b5ea-60a0b0a223d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:37.924159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:37.943051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:37.943862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:37.944146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:37.944443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:37.967871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:37.975985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:37.976948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:37.977776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:37.980502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 172/338] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:37.983146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:38.024316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 167/339] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:38.070971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db6c1a-3425-4c13-b5ea-60a0b0a223d8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:38.097154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:38.162386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70fc3-7391-4bab-8d07-28fde7611355 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:38.208808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:38.209844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:38.210282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:38.210719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:38.211621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:38.212111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:38.213833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:38.223066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db6c1a-3425-4c13-b5ea-60a0b0a223d8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:38.224475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 173/340] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:38.233210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:38.280038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:38.280942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:38.281294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:38.281646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:38.297787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:38.310922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:38.311967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:38.312787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:38.316288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 168/341] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:38.322253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:38.322673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:38.397092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3c61d-2542-4887-87bb-5d15888a58dd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:38.455795 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:38.456431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:38.457444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:38.457772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:38.458112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:38.503031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d89b58-45d0-43d2-8b79-771af30fca8f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:38.560425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:38.560813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:38.561114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:38.561406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:38.561687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:38.562293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:38.562504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:38.562816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:38.564302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:38.580548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 169/342] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:38.586138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:38.641727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:38.687797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 174/343] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:38.694258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:38.778494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e61fe-51a6-4ea2-b044-8c0c38ccebf8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:38.808793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d066-8ca0-4fe6-bea4-a35c3b098e44 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:38.837839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:38.838508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:38.838979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:38.839103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:38.854922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:38.856685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:38.859009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:38.859009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:38.859009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:38.860125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:38.861870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:38.867281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 175/344] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:38 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:38.872030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:38.900544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:38.993704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:38.995180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:39.058493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e76301-356f-42fa-88d5-1f8b945b63ab None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:39.142869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:39.144134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.144666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.145146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.161491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:39.163297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:39.165284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 176/345] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:38 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:39.171720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:39.191657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 170/346] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:59:39.196977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:39.268607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:39.313209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:39.337871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676668d-1396-445c-85d1-70b475e11a6c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:39.380952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a9795-36b8-4df5-b022-a12063dc3909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:39.381617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9795-36b8-4df5-b022-a12063dc3909 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.381902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9795-36b8-4df5-b022-a12063dc3909 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.382180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a9795-36b8-4df5-b022-a12063dc3909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.383017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a9795-36b8-4df5-b022-a12063dc3909 None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=e59320347df34780a2d5d9326481f6a6) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:39.383335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a9795-36b8-4df5-b022-a12063dc3909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:39.384850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a9795-36b8-4df5-b022-a12063dc3909 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:39.392822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 177/347] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:39 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:39.394160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c66c6-4f24-479e-a595-b11d4af3ac83 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.394450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c66c6-4f24-479e-a595-b11d4af3ac83 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.394626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1853a1c-4671-402e-9fdc-0d2ced8135da None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:39.394724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c66c6-4f24-479e-a595-b11d4af3ac83 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.397560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 178/348] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:39.405037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eaf29-9ac1-4d79-95f7-133d40275ed4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.405351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eaf29-9ac1-4d79-95f7-133d40275ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.405600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eaf29-9ac1-4d79-95f7-133d40275ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.439950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b11eaf29-9ac1-4d79-95f7-133d40275ed4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:39.441566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b11eaf29-9ac1-4d79-95f7-133d40275ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:39.501610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aaaad-ce3d-4c2d-8d52-b547e65364e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:39.502504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aaaad-ce3d-4c2d-8d52-b547e65364e8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.502790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aaaad-ce3d-4c2d-8d52-b547e65364e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.503067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aaaad-ce3d-4c2d-8d52-b547e65364e8 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.505233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aaaad-ce3d-4c2d-8d52-b547e65364e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:39.506895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aaaad-ce3d-4c2d-8d52-b547e65364e8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:39.509132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 171/349] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:39 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:39.510429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86110-7b49-4428-a96c-b958c484f27e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.510721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86110-7b49-4428-a96c-b958c484f27e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.511001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b86110-7b49-4428-a96c-b958c484f27e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.512673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 172/350] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:39.518205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4996e4-b1c9-4f28-b735-53fc1c100c51 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.518498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4996e4-b1c9-4f28-b735-53fc1c100c51 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.518776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4996e4-b1c9-4f28-b735-53fc1c100c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.553578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1a4996e4-b1c9-4f28-b735-53fc1c100c51 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:39.554821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1a4996e4-b1c9-4f28-b735-53fc1c100c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:39.560998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 179/351] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:39.566469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eaf29-9ac1-4d79-95f7-133d40275ed4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:39.683540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 173/352] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:39.684390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4996e4-b1c9-4f28-b735-53fc1c100c51 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:39.701533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:39.749630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:39.755093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eaf29-9ac1-4d79-95f7-133d40275ed4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:39.801437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:39.803296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.803806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.804318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.806266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:39.808424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:39.810903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 180/353] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:39 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:39.812532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:39.825198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4996e4-b1c9-4f28-b735-53fc1c100c51 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:39.875607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:39.876493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:39.876771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:39.877039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:39.892113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:39.900715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:39.901635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:39.903038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:39.905552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 174/354] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:39.906408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:39.961874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8251e-fff7-4306-aee3-43d18340fe43 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.010346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.011497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.011936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.012510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.021955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:40.025626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:40.031108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eeb4b-00fb-4e0b-8d7f-0a344d435c3d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.031976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:40.044377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:40.045508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:59:40.046468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:40.049136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 181/355] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:40.050813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:40.079008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.079726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.080471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.080471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.081424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=e59320347df34780a2d5d9326481f6a6) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:40.081931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:40.083485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:40.096441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 175/356] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:39 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=0f03c426f04e463da379c4eda6247694 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:40.097844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:40.217913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa953dc0-5216-4234-aae0-3ba70831eac1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.262682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.263776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.264245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.264686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.265642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:40.266130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:40.267799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:40.280507 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 182/357] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:40.293164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:40.304216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93741740-0031-4759-9610-e7e47edefa8d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.343561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3fb3-658c-4eb9-b313-cacfb58b463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3fb3-658c-4eb9-b313-cacfb58b463b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.344855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3fb3-658c-4eb9-b313-cacfb58b463b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.345133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3fb3-658c-4eb9-b313-cacfb58b463b None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.345890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3fb3-658c-4eb9-b313-cacfb58b463b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:40.346198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3fb3-658c-4eb9-b313-cacfb58b463b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:40.347932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3fb3-658c-4eb9-b313-cacfb58b463b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:40.361281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 176/358] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:40.367406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd113-e265-45d6-a877-3daac6fc4335 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.367406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd113-e265-45d6-a877-3daac6fc4335 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.367406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623cd113-e265-45d6-a877-3daac6fc4335 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.377589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 177/359] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:40 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:40.380250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e12d8-979a-497f-82c1-a52fc4491d48 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.380502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e12d8-979a-497f-82c1-a52fc4491d48 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.380779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e12d8-979a-497f-82c1-a52fc4491d48 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.382501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 178/360] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:40.383369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e12d8-979a-497f-82c1-a52fc4491d48 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:40.410690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:40.422194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:40.463316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b9e14-4614-4cdc-98f4-be887d7653c6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.513191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.513862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.514198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.514521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.529217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e12d8-979a-497f-82c1-a52fc4491d48 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.569143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be849ae8-94d6-4d39-9a94-c38a32648cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.570361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849ae8-94d6-4d39-9a94-c38a32648cef None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.570875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849ae8-94d6-4d39-9a94-c38a32648cef None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.571360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be849ae8-94d6-4d39-9a94-c38a32648cef None admin] PATH_INFO: `/v3/users/1082b4f9f15e4107a556ee535a8b7e9d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.572846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be849ae8-94d6-4d39-9a94-c38a32648cef None admin] RBAC: Authorizing `identity:get_user(user_id=1082b4f9f15e4107a556ee535a8b7e9d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:40.576004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be849ae8-94d6-4d39-9a94-c38a32648cef None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:40.578061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 179/361] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 20:59:40 2022] GET /identity/v3/users/1082b4f9f15e4107a556ee535a8b7e9d => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:40.579551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fce4a0-78f7-4990-9316-9439338efeed None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.580037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fce4a0-78f7-4990-9316-9439338efeed None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.580529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fce4a0-78f7-4990-9316-9439338efeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.599846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e6fce4a0-78f7-4990-9316-9439338efeed None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:40.601535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6fce4a0-78f7-4990-9316-9439338efeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:40.616769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:40.618501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:40.687954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 180/362] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:40.689701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777d835-0919-403e-8528-1f87ec554e40 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.690215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777d835-0919-403e-8528-1f87ec554e40 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.690688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777d835-0919-403e-8528-1f87ec554e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.703763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:40.708082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2777d835-0919-403e-8528-1f87ec554e40 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:40.709542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2777d835-0919-403e-8528-1f87ec554e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:40.728652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:40.758759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 183/363] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:59:40.764217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:40.803169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 181/364] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:40.803855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777d835-0919-403e-8528-1f87ec554e40 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:40.882299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b408f2-3bd3-485a-8f66-e24fe2494541 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.920512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.921548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.922095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.922587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.923602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] RBAC: Adding query filter params (role.id=75eaf9dbf23b401bb28030c3c0d2d561, user.id=1082b4f9f15e4107a556ee535a8b7e9d, scope.system=all) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:40.924110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:40.925977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:40.936473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777d835-0919-403e-8528-1f87ec554e40 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:40.940296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 184/365] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Jun 16 20:59:40 2022] GET /identity/v3/role_assignments?user.id=1082b4f9f15e4107a556ee535a8b7e9d&scope.system=all&role.id=75eaf9dbf23b401bb28030c3c0d2d561 => generated 510 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:40.941346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:40.967351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:40.980493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:40.981860 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:40.982307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:40.982732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:40.994773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:41.005134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:41.006272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:41.007071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:41.009635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 182/366] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:41.010738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.037981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:41.137694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdb195-d9e6-485d-82c1-3f426cb3d395 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.170832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ab4c9-00b4-4ad6-a9a4-91bbf5454c7b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.218459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.219269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.219551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.219826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.224493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.225637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.226119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.226773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.228221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:41.229884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:41.232562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:41.233001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 185/367] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:40 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:41.233985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:41.244885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:41.245891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:41.246663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:41.247267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 183/368] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:41.248734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.327873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:41.330689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:41.344712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362df18-a332-49c8-bd56-daf939b97d86 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.377886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc0dbb-568b-4fba-ba55-930e73c7941d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.384400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.385341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.385837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.386902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.387970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:41.388511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:41.390079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:41.398889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 186/369] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:41.400049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.421155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.421155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.421449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.421869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.422871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:41.424365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:41.426468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 184/370] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:41.427254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.512724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5114b4c-ea96-4ae3-83a1-43b25582cc2a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.548664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.549717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.550200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.550668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.551407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f07f7-3eb2-4647-91c5-b8611ca276ac None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.551831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:41.552377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:41.554061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:41.563893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 187/371] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:41.565119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.581487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:41.604711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.605561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.606072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.606363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.616669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:41.688014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c001f4b-683f-48db-99dc-6d021ea607d7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.691401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:41.692381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:41.727946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.729327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.729921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.730943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.732134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:41.732676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:41.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:41.741389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 188/372] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:41.742445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.841190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:41.845312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 185/373] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:41.851218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:41.865863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291019-f9b3-45e6-836c-1a2fe08db2ac None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:41.903610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:41.904784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:41.905334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:41.905882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:41.911420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:41.988053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:41.989861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:41.991496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2f1a6-31c5-4672-9405-bbc466d5efad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.032350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.033233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.033515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.033789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.035170 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:42.036683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:42.039074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 186/374] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:42.044928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:42.076239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:42.103598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 189/375] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:42.109307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:42.171946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1742ac-56dd-4ed8-810d-d3f5334106c5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.181800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:42.221256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.222244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.222785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.223071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.224445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:42.226326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:42.228032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 187/376] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:42 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:42.234691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:42.268233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d18bd-e64e-4fa9-8cd7-6c7c2dec5573 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.321714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906d743-613d-4882-8edd-ab3a80623eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.322669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d743-613d-4882-8edd-ab3a80623eab None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.322957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d743-613d-4882-8edd-ab3a80623eab None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.323235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906d743-613d-4882-8edd-ab3a80623eab None admin] PATH_INFO: `/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.324888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906d743-613d-4882-8edd-ab3a80623eab None admin] RBAC: Authorizing `identity:get_project(project_id=c0cca612cc8a4e54bb60862d1d2ad94b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:42.326343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906d743-613d-4882-8edd-ab3a80623eab None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:42.328713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 190/377] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:42 2022] GET /identity/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:42.329950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c568499-26ba-4f65-bd0e-2427fa97b856 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.330236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c568499-26ba-4f65-bd0e-2427fa97b856 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.330513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c568499-26ba-4f65-bd0e-2427fa97b856 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.336115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 191/378] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:42.337284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c568499-26ba-4f65-bd0e-2427fa97b856 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:42.377956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8871472-2d50-4f6a-8f51-fd4c7d615866 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.394631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:42.415525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8692d-9760-4ad6-b863-0e65e189551f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.416459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8692d-9760-4ad6-b863-0e65e189551f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.416840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8692d-9760-4ad6-b863-0e65e189551f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.417219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8692d-9760-4ad6-b863-0e65e189551f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.418671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8692d-9760-4ad6-b863-0e65e189551f None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:42.419599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8692d-9760-4ad6-b863-0e65e189551f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:42.421213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8692d-9760-4ad6-b863-0e65e189551f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:42.427532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 188/379] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:42 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=0f03c426f04e463da379c4eda6247694 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:42.429039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d86654-e8fe-4254-9aaf-1922684427d1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.429433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d86654-e8fe-4254-9aaf-1922684427d1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.429811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d86654-e8fe-4254-9aaf-1922684427d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.448556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d1d86654-e8fe-4254-9aaf-1922684427d1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:42.450825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d1d86654-e8fe-4254-9aaf-1922684427d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:42.470678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c568499-26ba-4f65-bd0e-2427fa97b856 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.485649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:42.519352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.520570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.521017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.521445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] PATH_INFO: `/v3/groups/f3f1406de8bc4a36bce402a70f7e9207` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.527826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] RBAC: Authorizing `identity:get_group(group_id=f3f1406de8bc4a36bce402a70f7e9207)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:42.529708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:42.531078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 189/380] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:42.531961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 192/381] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:42 2022] GET /identity/v3/groups/f3f1406de8bc4a36bce402a70f7e9207 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:42.537838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d86654-e8fe-4254-9aaf-1922684427d1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:42.559207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:42.685306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d86654-e8fe-4254-9aaf-1922684427d1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.713033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77726c9e-c627-4d32-8ef6-de9ce272da2c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.724020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.725008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.725479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.725936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.726387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:42.727664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] RBAC: Adding query filter params (group.id=f3f1406de8bc4a36bce402a70f7e9207, role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=c0cca612cc8a4e54bb60862d1d2ad94b) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:42.727911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:42.729716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:42.736043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 190/382] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:42 2022] GET /identity/v3/role_assignments?group.id=f3f1406de8bc4a36bce402a70f7e9207&scope.project.id=c0cca612cc8a4e54bb60862d1d2ad94b&role.id=b7564b3ff8064aa09459135574f0a043 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:42.757520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb4531-4060-4513-92c9-46a104d5cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.758938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4531-4060-4513-92c9-46a104d5cc5c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.759381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4531-4060-4513-92c9-46a104d5cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.759811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb4531-4060-4513-92c9-46a104d5cc5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.773395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb4531-4060-4513-92c9-46a104d5cc5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3beb4531-4060-4513-92c9-46a104d5cc5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:42.782542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:42.783652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:42.784678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:42.787078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 193/383] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:42.793243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:42.829470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:42.918354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f205b20-232d-4b51-a72a-69103f131da1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:42.932273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668ff4-20b3-4669-b9a0-ef1e2f1aba63 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.933687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668ff4-20b3-4669-b9a0-ef1e2f1aba63 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.934203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8668ff4-20b3-4669-b9a0-ef1e2f1aba63 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.935906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 194/384] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:42.954447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cdee9-e4b3-4c91-b981-bf2eed548164 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.955232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cdee9-e4b3-4c91-b981-bf2eed548164 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.955790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25cdee9-e4b3-4c91-b981-bf2eed548164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.972917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:42.973602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:42.973895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:42.974155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:42.974916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:42.975219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:42.976653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:42.995175 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a25cdee9-e4b3-4c91-b981-bf2eed548164 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:42.996978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a25cdee9-e4b3-4c91-b981-bf2eed548164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:42.999450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 191/385] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:43.006394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:43.111116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 195/386] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:43.145404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cdee9-e4b3-4c91-b981-bf2eed548164 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:43.149478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:43.166262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0f322-bd11-473e-8cf2-132e8d633f84 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:43.239206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:43.240079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:43.240389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:43.240671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:43.243571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:43.245086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:43.247615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 192/387] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:43 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:43.253124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:43.306008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:43.313047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25cdee9-e4b3-4c91-b981-bf2eed548164 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:43.387444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:43.388525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:43.388972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:43.389414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:43.405666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8bc0a-224b-4b0c-957e-7de54a653128 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:43.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:43.430027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:43.430926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:43.431718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 196/388] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:43.438167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:43.483928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:43.484861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:43.485154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:43.485419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:43.491325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:43.494061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:43.501384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 193/389] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:43 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:43.506077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:43.564891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:43.625114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f6f18-4fb6-4733-8ee0-6adf8680d1cb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:43.684316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:43.684928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:43.685210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:43.685487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:43.686240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:43.686548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:43.687923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:43.698561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40b054-e73e-4f36-b09a-2738f5eb8695 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:43.708643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 197/390] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:43.709522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:43.744828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:43.766551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:43.767448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:43.767735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:43.768013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:43.774248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e59320347df34780a2d5d9326481f6a6, group_id=3f4e46355d234a2cb9549c23797a9c4c, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:43.775697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:43.811758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 194/391] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 16 20:59:43 2022] PUT /identity/v3/projects/e59320347df34780a2d5d9326481f6a6/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:43.850435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627b9c7-c8ff-42fe-ae47-808458c64234 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:43.889810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:43.891037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:43.891532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:43.892016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:43.893474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:43.895137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:43.897148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 198/392] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:43 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:43.904458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:44.044702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:44.063976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c0b67-02a4-4553-8c13-f9a653eda3c9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:44.101564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216ef95-11c3-4f31-83fc-d5e0be02aeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:44.102451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216ef95-11c3-4f31-83fc-d5e0be02aeab None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:44.102733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216ef95-11c3-4f31-83fc-d5e0be02aeab None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:44.103008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216ef95-11c3-4f31-83fc-d5e0be02aeab None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:44.104225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216ef95-11c3-4f31-83fc-d5e0be02aeab None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:44.106970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216ef95-11c3-4f31-83fc-d5e0be02aeab None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:44.109035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 195/393] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:43 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:44.114567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:44.235692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:44.253797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748293c4-25cb-4646-83cb-294555fcf9e0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:44.291568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e0bb8-6a2e-41da-9be0-431b60ab3a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:44.293506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e0bb8-6a2e-41da-9be0-431b60ab3a6a None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:44.294023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e0bb8-6a2e-41da-9be0-431b60ab3a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:44.294610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e0bb8-6a2e-41da-9be0-431b60ab3a6a None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:44.297171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e0bb8-6a2e-41da-9be0-431b60ab3a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=e59320347df34780a2d5d9326481f6a6, group_id=3f4e46355d234a2cb9549c23797a9c4c, role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:44.298842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e0bb8-6a2e-41da-9be0-431b60ab3a6a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:44.315360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 199/394] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 16 20:59:44 2022] PUT /identity/v3/projects/e59320347df34780a2d5d9326481f6a6/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/0f03c426f04e463da379c4eda6247694 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:44.837859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd648-c41c-465f-a728-598755c749bb None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:44.838240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd648-c41c-465f-a728-598755c749bb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:44.838429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd648-c41c-465f-a728-598755c749bb None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:44.840845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 196/395] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:44.845893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98015-c1a7-466c-9d50-0d433b35cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:44.846179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98015-c1a7-466c-9d50-0d433b35cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:44.846454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da98015-c1a7-466c-9d50-0d433b35cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:44.867246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4da98015-c1a7-466c-9d50-0d433b35cbb7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:44.868380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4da98015-c1a7-466c-9d50-0d433b35cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:44.947162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 200/396] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:44.983084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fd648-c41c-465f-a728-598755c749bb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:45.120939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fd648-c41c-465f-a728-598755c749bb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:45.173625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:45.174438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.174722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.175000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.195249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:45.203915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:45.204886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:45.205685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 197/397] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:45.211024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da98015-c1a7-466c-9d50-0d433b35cbb7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:45.344707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:45.373026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da98015-c1a7-466c-9d50-0d433b35cbb7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:45.419887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c45de-e37b-48d5-8208-a43a7ebd1079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:45.420595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c45de-e37b-48d5-8208-a43a7ebd1079 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.420889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c45de-e37b-48d5-8208-a43a7ebd1079 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.421142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c45de-e37b-48d5-8208-a43a7ebd1079 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.421889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c45de-e37b-48d5-8208-a43a7ebd1079 None admin] RBAC: Adding query filter params (name=member) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:45.422190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c45de-e37b-48d5-8208-a43a7ebd1079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:45.423571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c45de-e37b-48d5-8208-a43a7ebd1079 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:45.435730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 201/398] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:45.439566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:45.478059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f6c4-979a-4754-9586-81615e1f4179 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.478403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f6c4-979a-4754-9586-81615e1f4179 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.478619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13f6c4-979a-4754-9586-81615e1f4179 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.480071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 202/399] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:45.483346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:45.486861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a77f92-80f8-42d4-ae7c-bca49cb7ba5f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.487154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a77f92-80f8-42d4-ae7c-bca49cb7ba5f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.487929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a77f92-80f8-42d4-ae7c-bca49cb7ba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.527085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-97a77f92-80f8-42d4-ae7c-bca49cb7ba5f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:45.528950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-97a77f92-80f8-42d4-ae7c-bca49cb7ba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:45.661403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1169-0e07-484f-8140-6ff3c9001a0d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:45.688208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 203/400] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:45.689700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110187e3-c430-4f49-8331-fd3a1beaf698 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.689988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110187e3-c430-4f49-8331-fd3a1beaf698 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.690266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110187e3-c430-4f49-8331-fd3a1beaf698 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.691534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 204/401] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:45.699285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb2512-7e5d-4fc3-9c8c-556127f019f2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.699285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb2512-7e5d-4fc3-9c8c-556127f019f2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.699285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb2512-7e5d-4fc3-9c8c-556127f019f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.710811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:45.711965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.712484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.713053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.714516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:45.716295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6dbb2512-7e5d-4fc3-9c8c-556127f019f2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:45.716658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:45.717497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6dbb2512-7e5d-4fc3-9c8c-556127f019f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:45.718728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 198/402] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:45 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:45.724355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:45.788001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:45.794789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 205/403] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:45.795651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb2512-7e5d-4fc3-9c8c-556127f019f2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:45.834519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:45.859058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cd02ba-21e9-4208-b6d7-1888125f8252 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:45.902446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:45.903507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:45.903792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:45.904066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:45.906680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:45.908130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:45.910032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 199/404] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:45 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:45.912335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:45.952381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb2512-7e5d-4fc3-9c8c-556127f019f2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:45.999459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.000861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.001502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.001965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.018120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:46.032050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:46.033573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:46.034351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:46.037291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 206/405] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:46.038408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.049008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211ee0c-8dc8-4481-b593-a0b6a0e23859 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.090386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.091203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.091494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.091775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.103615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:46.114700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:46.115820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 200/406] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:46.120887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.127674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:46.140430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:46.180543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7ce1f-eb2c-4d6e-8e16-954f350d8afd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.221120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.221989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.222274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.222561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.224893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] RBAC: Authorizing `identity:create_grant(project_id=78e22ce2e5004c9eb6f68a72d97dadd3, group_id=3f4e46355d234a2cb9549c23797a9c4c, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.228509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:46.249096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 207/407] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 16 20:59:46 2022] PUT /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:46.250001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.256205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1622cd-06b7-4539-8ccc-e30ad2546463 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.336062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.337197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.337498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.339194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.342694 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:46.343119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.345786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:46.365862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 201/408] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:46.371597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.449947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eae358-2362-413f-bd25-1cae87485a69 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.464879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:46.476613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:46.493600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.494314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.494608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.494837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b9368-c910-42bb-9d1c-61c217f21ba8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.494952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.496255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:46.496679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.498218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:46.509128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 208/409] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:46.515138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.538777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.539691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.539988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.540298 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.541594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.543763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:46.545925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 202/410] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:46 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:46.551352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.638682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d871d-3657-45ea-95f9-af73462b4258 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.678142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e4f52-109b-4cb7-aa92-18c85c96a33e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.679056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.680237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.680742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.681190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] PATH_INFO: `/v3/groups/f3f1406de8bc4a36bce402a70f7e9207` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.682586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] RBAC: Authorizing `identity:get_group(group_id=f3f1406de8bc4a36bce402a70f7e9207)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.686381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:46.688725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 209/411] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:46 2022] GET /identity/v3/groups/f3f1406de8bc4a36bce402a70f7e9207 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:46.694863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.717287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.718146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.718436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.718716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.720041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.721624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:46.725187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 203/412] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:46 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:46.731808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.764578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:46.772206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:46.865960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a023a-a01f-49d1-a0ae-e238348468d6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.942819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a9438-0ce9-43a8-86e4-a4e675ce02c7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:46.945032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b323de6-a469-4ded-9281-e53855c7c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.946000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323de6-a469-4ded-9281-e53855c7c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.946289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323de6-a469-4ded-9281-e53855c7c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.946560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b323de6-a469-4ded-9281-e53855c7c8a0 None admin] PATH_INFO: `/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.948215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b323de6-a469-4ded-9281-e53855c7c8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cca612cc8a4e54bb60862d1d2ad94b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.950610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b323de6-a469-4ded-9281-e53855c7c8a0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:46.952673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 210/413] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:46 2022] GET /identity/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:46.953882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f784f-2058-4d59-95e7-403da501d2da None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.954166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f784f-2058-4d59-95e7-403da501d2da None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.954440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21f784f-2058-4d59-95e7-403da501d2da None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.962925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 211/414] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:46.962925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f784f-2058-4d59-95e7-403da501d2da None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:46.990997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2362d1-0ec7-4d0c-af31-aafa50761be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:46.991731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2362d1-0ec7-4d0c-af31-aafa50761be8 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:46.992135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2362d1-0ec7-4d0c-af31-aafa50761be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:46.992537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2362d1-0ec7-4d0c-af31-aafa50761be8 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:46.995092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2362d1-0ec7-4d0c-af31-aafa50761be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=78e22ce2e5004c9eb6f68a72d97dadd3, group_id=3f4e46355d234a2cb9549c23797a9c4c, role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:46.997154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2362d1-0ec7-4d0c-af31-aafa50761be8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:47.013790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 204/415] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 16 20:59:46 2022] PUT /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3/groups/3f4e46355d234a2cb9549c23797a9c4c/roles/0f03c426f04e463da379c4eda6247694 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:59:47.015575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388437ae-f8bc-40cb-8e3d-75e51d3087a3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.015980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388437ae-f8bc-40cb-8e3d-75e51d3087a3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.016336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388437ae-f8bc-40cb-8e3d-75e51d3087a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.036723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-388437ae-f8bc-40cb-8e3d-75e51d3087a3 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:47.038133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-388437ae-f8bc-40cb-8e3d-75e51d3087a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:47.086099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21f784f-2058-4d59-95e7-403da501d2da None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:47.107384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:47.128074 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00130e42-5e97-4f58-a192-616db3ec6d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:47.129130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00130e42-5e97-4f58-a192-616db3ec6d21 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.129516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00130e42-5e97-4f58-a192-616db3ec6d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.129892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00130e42-5e97-4f58-a192-616db3ec6d21 None admin] PATH_INFO: `/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b/groups/f3f1406de8bc4a36bce402a70f7e9207/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.131974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00130e42-5e97-4f58-a192-616db3ec6d21 None admin] RBAC: Authorizing `identity:create_grant(project_id=c0cca612cc8a4e54bb60862d1d2ad94b, group_id=f3f1406de8bc4a36bce402a70f7e9207, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:47.133691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00130e42-5e97-4f58-a192-616db3ec6d21 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:47.142042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 205/416] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:47.170596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 212/417] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Jun 16 20:59:46 2022] PUT /identity/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b/groups/f3f1406de8bc4a36bce402a70f7e9207/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:59:47.173001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388437ae-f8bc-40cb-8e3d-75e51d3087a3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:47.177419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:47.318678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388437ae-f8bc-40cb-8e3d-75e51d3087a3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:47.319456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08317-32e2-43c8-bc30-b0d3287008cb None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.319787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08317-32e2-43c8-bc30-b0d3287008cb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.320016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b08317-32e2-43c8-bc30-b0d3287008cb None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.322013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 213/418] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:47.327584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252a803-1364-4928-b820-a68e657a552b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.328430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252a803-1364-4928-b820-a68e657a552b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.328430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252a803-1364-4928-b820-a68e657a552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.359162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:47.360101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.360468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.360738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.373358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c252a803-1364-4928-b820-a68e657a552b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:47.373547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:47.374592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c252a803-1364-4928-b820-a68e657a552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:47.381861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:47.382866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:47.383885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 206/419] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:47.389626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:47.461703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:47.518227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 214/420] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:47.525349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41b839-01b0-4d6b-82dc-7d20930e02c3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:47.542839 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252a803-1364-4928-b820-a68e657a552b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:47.632989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:47.633672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.633955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.634233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.634999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:47.635309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:47.637432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:47.651777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 207/421] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:47.661251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252a803-1364-4928-b820-a68e657a552b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:47.670571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:47.673770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:47.737454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:47.738820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.740608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.741664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.761796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:47.779981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:47.780970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:47.781780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:47.789502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 215/422] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:47.793675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:47.896917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c363895-cb75-4f53-9397-026d1828d8a4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:47.902859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9a31-644f-4c41-a33e-b5f7673a09e1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:47.943037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:47.946544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:47.947460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.947943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.948502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.950837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:47.951561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:47.954995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:47.964921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 216/423] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:47.966725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:47.967389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:47.967675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:47.967950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:47.976238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:48.036585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:48.088570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8278b18-7164-421d-9c74-26d077b285e2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:48.092001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:48.093503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:48.188982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:48.189576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:48.189862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:48.190139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:48.208422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 208/424] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:48.217366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:48.246293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:48.293851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:48.295808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:48.332083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:48.402509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 217/425] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:48.410111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:48.438776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a9d5a-6b83-4f96-9771-517de4159a5e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:48.507026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:48.507809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:48.508091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:48.508389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:48.510775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:48.512859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:48.519945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 209/426] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:48 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:48.523770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:48.575868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8630f-97e1-4ea2-9ad7-10dff6448028 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:48.607672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:48.615033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:48.615921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:48.616231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:48.616516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] PATH_INFO: `/v3/projects/e59320347df34780a2d5d9326481f6a6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:48.617727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] RBAC: Authorizing `identity:get_project(project_id=e59320347df34780a2d5d9326481f6a6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:48.619357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:48.621563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 218/427] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:48 2022] GET /identity/v3/projects/e59320347df34780a2d5d9326481f6a6 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:48.633215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:48.716583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:48.729803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4898e-2838-44c6-863c-7702ac369816 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:48.801863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6e39e-2b76-4537-a36e-9b2b0ed4ffcf None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:48.827566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc123a-32af-45ce-a433-4dfb26491da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:48.829084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc123a-32af-45ce-a433-4dfb26491da6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:48.829810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc123a-32af-45ce-a433-4dfb26491da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:48.830698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc123a-32af-45ce-a433-4dfb26491da6 None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:48.832682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc123a-32af-45ce-a433-4dfb26491da6 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:48.835153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc123a-32af-45ce-a433-4dfb26491da6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:48.837904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 210/428] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:48 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:48.838437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:48.840045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50508925-3c97-4439-9acc-4b43133e64c6 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:48.840264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:48.840665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:48.840773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50508925-3c97-4439-9acc-4b43133e64c6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:48.841109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:48.841325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50508925-3c97-4439-9acc-4b43133e64c6 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:48.842516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:48.847033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:48.847033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 219/430] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:48 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:48.847247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:48.847376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 211/430] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:48.849089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fee242-0546-48d0-9f8c-86799d3dab42 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:48.849539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fee242-0546-48d0-9f8c-86799d3dab42 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:48.849956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fee242-0546-48d0-9f8c-86799d3dab42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:48.876889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-51fee242-0546-48d0-9f8c-86799d3dab42 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:48.878931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-51fee242-0546-48d0-9f8c-86799d3dab42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:48.925993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:48.975732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 212/431] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:48.975732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fee242-0546-48d0-9f8c-86799d3dab42 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:48.984028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555207e9-dce1-4826-9288-69d4600c010e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:49.037197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:49.038475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:49.038983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:49.039910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:49.041264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=e59320347df34780a2d5d9326481f6a6) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:49.042029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:49.044138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:49.053242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 220/432] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:48 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:49.054302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:49.088341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:49.118671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fee242-0546-48d0-9f8c-86799d3dab42 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:49.191364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af7d89-7c9c-4690-bcb9-ee2c4a2ff6ba None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:49.218148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:49.218696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:49.218859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:49.219137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:49.219983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=e59320347df34780a2d5d9326481f6a6) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:49.220324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:49.221800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:49.231908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 213/433] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:48 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=e59320347df34780a2d5d9326481f6a6&role.id=0f03c426f04e463da379c4eda6247694 => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:49.234476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:49.242964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:49.244080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:49.244535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:49.244977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:49.258743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:49.267751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:49.268987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:59:49.269977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:49.272416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 221/434] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:49.278194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:49.399422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffaf07-5fb2-4117-a123-0400dc8b9481 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:49.438808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4b38e-02bd-4806-ad3a-db9e14f4a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:49.439838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4b38e-02bd-4806-ad3a-db9e14f4a94e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:49.440287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4b38e-02bd-4806-ad3a-db9e14f4a94e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:49.440705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4b38e-02bd-4806-ad3a-db9e14f4a94e None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:49.441596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4b38e-02bd-4806-ad3a-db9e14f4a94e None admin] RBAC: Adding query filter params (name=member) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:49.442060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4b38e-02bd-4806-ad3a-db9e14f4a94e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:49.443667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c4b38e-02bd-4806-ad3a-db9e14f4a94e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:49.453419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 214/435] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 20:59:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:49.458555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:49.582627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca2510-fbc0-41fa-a029-60804660a777 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:49.630002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:49.630701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:49.630987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:49.631264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:49.695715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542682-fcb7-4fae-a56b-598c29e5da9f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:49.695907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542682-fcb7-4fae-a56b-598c29e5da9f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:49.696285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1542682-fcb7-4fae-a56b-598c29e5da9f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:49.697710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 215/436] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:59:49.702636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:49.706325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333329d-af41-4e31-9068-84672263d5be None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:49.706611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333329d-af41-4e31-9068-84672263d5be None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:49.706883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333329d-af41-4e31-9068-84672263d5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:49.715871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:49.718026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:49.734090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d333329d-af41-4e31-9068-84672263d5be None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:49.737761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d333329d-af41-4e31-9068-84672263d5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:49.753107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:49.829258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 216/437] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:49.846427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 222/438] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:59:49.852453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333329d-af41-4e31-9068-84672263d5be None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:49.858876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:49.973923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333329d-af41-4e31-9068-84672263d5be None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:49.976068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:49.987970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4c06-1142-45a5-9355-6cb15ff825de None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.007993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925365f4-7c66-48a5-86b7-08a39f8a81d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.008883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925365f4-7c66-48a5-86b7-08a39f8a81d1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.009160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925365f4-7c66-48a5-86b7-08a39f8a81d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.009430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925365f4-7c66-48a5-86b7-08a39f8a81d1 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.010586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925365f4-7c66-48a5-86b7-08a39f8a81d1 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.012632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925365f4-7c66-48a5-86b7-08a39f8a81d1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.014306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 217/439] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:49 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:50.015457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9639-3a21-4841-93b6-3776e3166863 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.015738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9639-3a21-4841-93b6-3776e3166863 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.016009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a9639-3a21-4841-93b6-3776e3166863 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.017245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 218/440] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:50.019589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a9639-3a21-4841-93b6-3776e3166863 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.027739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd56cc9-cda9-4a46-b5d1-3a7f9b5cee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.028587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd56cc9-cda9-4a46-b5d1-3a7f9b5cee87 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.028868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd56cc9-cda9-4a46-b5d1-3a7f9b5cee87 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.029143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd56cc9-cda9-4a46-b5d1-3a7f9b5cee87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.034779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.039468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd56cc9-cda9-4a46-b5d1-3a7f9b5cee87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bdd56cc9-cda9-4a46-b5d1-3a7f9b5cee87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:50.047736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:50.048772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:50.049561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 223/441] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:50.050225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7020cf3-ee2a-49fa-b1a3-c613fc17383c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.050514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7020cf3-ee2a-49fa-b1a3-c613fc17383c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.050743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7020cf3-ee2a-49fa-b1a3-c613fc17383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.067531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e7020cf3-ee2a-49fa-b1a3-c613fc17383c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:50.068754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e7020cf3-ee2a-49fa-b1a3-c613fc17383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:50.128628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a9639-3a21-4841-93b6-3776e3166863 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.136144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 224/442] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:50.137012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7020cf3-ee2a-49fa-b1a3-c613fc17383c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.163724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.164614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.164901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.165184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.166355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.168414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.170025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 219/443] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:50.170780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.232353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.250475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.252989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7020cf3-ee2a-49fa-b1a3-c613fc17383c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.271067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2564e9e-f8fd-496f-8f27-aa5afe6591dc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.288459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.289128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.289412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.289690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.290438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:50.290748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.292121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.301020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 225/444] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:50.301708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.305974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.306774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.307062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.307348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.317615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:50.326032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:50.326900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:50.327702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 220/445] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:50.328458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.403437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf52e7-e4e4-4aa3-8eb9-f683c943155b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.429043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2e65-948d-44bf-b219-0bf9ce78fb87 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.436486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.437140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.437478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.438027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.438583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=9aa8f94e3f1446a788810d3425df2ccf, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:50.438899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.440366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.446033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 226/446] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=9aa8f94e3f1446a788810d3425df2ccf => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:50.446807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.456319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.469933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.470620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.470996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.471315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.490069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.561405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.562911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.565724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58bdf3-0dc8-4811-abc3-88d66ece8940 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.613107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.613803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.614087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.614365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.615126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:50.615436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.616847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.628560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 227/447] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:50.634793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.688037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 221/448] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:50.694004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.712594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.738496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.758252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a72ba3-21b2-438b-9fee-b30ceb10e3a1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.800012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.800707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.800985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.801254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.807190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5367bc-0f72-4da0-adb9-a6c9e6ea8e7b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.847667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.848840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.849123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.849397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] PATH_INFO: `/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.850575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] RBAC: Authorizing `identity:get_project(project_id=78e22ce2e5004c9eb6f68a72d97dadd3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.852022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.853752 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 222/449] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/projects/78e22ce2e5004c9eb6f68a72d97dadd3 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:50.859968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.876677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.878126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.942598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.957964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa3ba3-ef27-4687-9d87-67e798d95c81 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:50.969223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:50.978064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 228/450] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:59:50.983597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:50.993687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:50.994550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:50.994827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:50.995101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] PATH_INFO: `/v3/groups/3f4e46355d234a2cb9549c23797a9c4c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:50.996758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] RBAC: Authorizing `identity:get_group(group_id=3f4e46355d234a2cb9549c23797a9c4c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:50.998210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:50.999807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 223/451] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/groups/3f4e46355d234a2cb9549c23797a9c4c => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:51.005704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:51.085652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e328e4-71cc-4e8b-9f10-d6b307c8f57d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:51.103101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bd3db-9aed-4e3c-b4ab-a79f069beca5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:51.120148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:51.122090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:51.122367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:51.122639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] PATH_INFO: `/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:51.123822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] RBAC: Authorizing `identity:get_project(project_id=c0cca612cc8a4e54bb60862d1d2ad94b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:51.125316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:51.126993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 229/452] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 20:59:50 2022] GET /identity/v3/projects/c0cca612cc8a4e54bb60862d1d2ad94b => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:51.132522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:51.136611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:51.137348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:51.137634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:51.137927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:51.138737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] RBAC: Adding query filter params (group.id=3f4e46355d234a2cb9549c23797a9c4c, role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:51.139054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:51.140516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:51.146272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 224/453] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:51 2022] GET /identity/v3/role_assignments?group.id=3f4e46355d234a2cb9549c23797a9c4c&scope.project.id=78e22ce2e5004c9eb6f68a72d97dadd3&role.id=0f03c426f04e463da379c4eda6247694 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:51.170002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:51.239407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277bcd8-1c14-4f6b-842a-6f88b3da9a66 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:51.274173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22967d-c6fd-4cbc-bf21-4ee405d1f8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:51.275039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22967d-c6fd-4cbc-bf21-4ee405d1f8be None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:51.275320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22967d-c6fd-4cbc-bf21-4ee405d1f8be None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:51.275593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22967d-c6fd-4cbc-bf21-4ee405d1f8be None admin] PATH_INFO: `/v3/groups/f3f1406de8bc4a36bce402a70f7e9207` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:51.277358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22967d-c6fd-4cbc-bf21-4ee405d1f8be None admin] RBAC: Authorizing `identity:get_group(group_id=f3f1406de8bc4a36bce402a70f7e9207)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:51.278843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22967d-c6fd-4cbc-bf21-4ee405d1f8be None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:51.280857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 230/454] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Jun 16 20:59:51 2022] GET /identity/v3/groups/f3f1406de8bc4a36bce402a70f7e9207 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:59:51.286901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:51.341341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:51.400881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6a32-29f1-4812-9262-00dac0b52c6f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:51.434593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6f725-613e-4132-9984-87e722d9ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:51.435279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f725-613e-4132-9984-87e722d9ee46 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:51.435556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f725-613e-4132-9984-87e722d9ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:51.435830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6f725-613e-4132-9984-87e722d9ee46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:51.436687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f725-613e-4132-9984-87e722d9ee46 None admin] RBAC: Adding query filter params (group.id=f3f1406de8bc4a36bce402a70f7e9207, role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=c0cca612cc8a4e54bb60862d1d2ad94b) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:51.437001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f725-613e-4132-9984-87e722d9ee46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:51.438435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6f725-613e-4132-9984-87e722d9ee46 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:51.444368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 225/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Jun 16 20:59:51 2022] GET /identity/v3/role_assignments?group.id=f3f1406de8bc4a36bce402a70f7e9207&scope.project.id=c0cca612cc8a4e54bb60862d1d2ad94b&role.id=b7564b3ff8064aa09459135574f0a043 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:54.205689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f473f-e201-43cc-82b6-0aebe11e9920 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.206243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f473f-e201-43cc-82b6-0aebe11e9920 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.206243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f473f-e201-43cc-82b6-0aebe11e9920 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.207842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 231/456] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:54.226155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59d23-bc40-444e-9334-515959aefe5b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.226678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59d23-bc40-444e-9334-515959aefe5b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.226756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c59d23-bc40-444e-9334-515959aefe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.248090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-59c59d23-bc40-444e-9334-515959aefe5b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:54.249359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-59c59d23-bc40-444e-9334-515959aefe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:54.320406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904afc0-26fe-42aa-861f-4e665cfc4e73 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.320689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904afc0-26fe-42aa-861f-4e665cfc4e73 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.321198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904afc0-26fe-42aa-861f-4e665cfc4e73 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.324162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 232/457] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:54.328478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22c34-eab5-4755-a7df-7f83534e03e6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.328995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22c34-eab5-4755-a7df-7f83534e03e6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.329496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22c34-eab5-4755-a7df-7f83534e03e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.349381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8ce22c34-eab5-4755-a7df-7f83534e03e6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:54.350848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8ce22c34-eab5-4755-a7df-7f83534e03e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:54.360193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 226/458] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:54.379698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c59d23-bc40-444e-9334-515959aefe5b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:54.420166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:54.493276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c59d23-bc40-444e-9334-515959aefe5b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:54.531137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 233/459] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:54.531137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc60a-7b93-4309-a362-0c28d8eacf26 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.531137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc60a-7b93-4309-a362-0c28d8eacf26 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.531137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc60a-7b93-4309-a362-0c28d8eacf26 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.532286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 234/460] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:54.536323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6870f7-b39b-4660-929c-2772542b2777 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.536615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6870f7-b39b-4660-929c-2772542b2777 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.536901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6870f7-b39b-4660-929c-2772542b2777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.540468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:54.542488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.542956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.543276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.560551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cd6870f7-b39b-4660-929c-2772542b2777 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:54.561776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cd6870f7-b39b-4660-929c-2772542b2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:54.565385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:54.567248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:59:54.588098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:54.589291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:54.590417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:59:54.590417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:59:54.590417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:54.590417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:54.597067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 227/461] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:54.597400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:54.610345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:54.648909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 235/462] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:54.649761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6870f7-b39b-4660-929c-2772542b2777 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:54.708195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:54.723291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a6ea7-2378-4eb7-8392-3dc29c185783 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:54.757573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6870f7-b39b-4660-929c-2772542b2777 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:54.763961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1f2b3-99be-4099-ace2-eea6dc50e3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:54.764790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f2b3-99be-4099-ace2-eea6dc50e3cb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.765075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f2b3-99be-4099-ace2-eea6dc50e3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.765617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f2b3-99be-4099-ace2-eea6dc50e3cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.775524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1f2b3-99be-4099-ace2-eea6dc50e3cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:54.778359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f1f2b3-99be-4099-ace2-eea6dc50e3cb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:54.794532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:54.795192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.795476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.795751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.796497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:54.796806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:54.798188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-40f1f2b3-99be-4099-ace2-eea6dc50e3cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:59:54.798791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:54.799581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:54.800444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:59:54.800444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:59:54.800444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:54.800444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:54.800444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 228/463] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:54.801230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7d334-e300-4d9f-95ca-8db7aedd7d98 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.801479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7d334-e300-4d9f-95ca-8db7aedd7d98 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.801756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7d334-e300-4d9f-95ca-8db7aedd7d98 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.807501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 229/464] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:54.807501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7d334-e300-4d9f-95ca-8db7aedd7d98 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:54.816780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 236/465] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:54.821890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:54.848788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:54.920475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b7d334-e300-4d9f-95ca-8db7aedd7d98 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:54.932117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d00115-0e95-4a28-bd33-05b5a8373bcd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:54.958048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:54.958849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.959152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.959446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.969472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:54.969695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5b965-c742-4baa-8e5f-e60e22129c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:54.970356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b965-c742-4baa-8e5f-e60e22129c6b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.970638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b965-c742-4baa-8e5f-e60e22129c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.970934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5b965-c742-4baa-8e5f-e60e22129c6b None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.971641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b965-c742-4baa-8e5f-e60e22129c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:54.971947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b965-c742-4baa-8e5f-e60e22129c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:54.972379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:54.973624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae5b965-c742-4baa-8e5f-e60e22129c6b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:54.974632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:54.986444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 237/466] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:54.987698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73565511-e48d-4f3e-b96c-15bd26c1792f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:54.987990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73565511-e48d-4f3e-b96c-15bd26c1792f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:54.988302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73565511-e48d-4f3e-b96c-15bd26c1792f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:59:54.994506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:54.995351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:54.996854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:59:54.996854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:59:54.996854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:54.996854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:54.996854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 230/467] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:54.997133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.008492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-73565511-e48d-4f3e-b96c-15bd26c1792f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:55.009625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-73565511-e48d-4f3e-b96c-15bd26c1792f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:55.080416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 238/468] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:55.081252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73565511-e48d-4f3e-b96c-15bd26c1792f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.103519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:55.114724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71bf9a-9157-47da-a404-f554b3488f46 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.149040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:55.149710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.149995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.150269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.150976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:55.153260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:55.173358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 231/469] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:54 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:55.174212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.227607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73565511-e48d-4f3e-b96c-15bd26c1792f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.238167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:55.281425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:55.282706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.283131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.283718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.284659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:55.286598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:55.304681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a40c8-6576-4582-862f-fba509ef697d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.322403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 239/470] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:55 2022] POST /identity/v3/users => generated 246 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:59:55.322403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.379558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:55.380606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.380886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.381160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.382081 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:55.382737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:55.384561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:55.410037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 232/471] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:55.415482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.464681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:55.498258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b3dfe-de27-46cc-8b2a-b4a1efa62043 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.553243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d73ae-ebc0-41cd-96ee-a11abbee232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:55.554324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d73ae-ebc0-41cd-96ee-a11abbee232a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.554611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d73ae-ebc0-41cd-96ee-a11abbee232a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.555135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d73ae-ebc0-41cd-96ee-a11abbee232a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.567816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03de022-9114-43cb-8319-5a09af426d91 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.574244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d73ae-ebc0-41cd-96ee-a11abbee232a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:55.576712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d73ae-ebc0-41cd-96ee-a11abbee232a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:55.580353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-438d73ae-ebc0-41cd-96ee-a11abbee232a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:59:55.596585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:55.597492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:55.598607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:59:55.598607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:59:55.598607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:55.598607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:55.598824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 240/472] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:55.602557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf38b-ee45-47da-b2e6-7be1b9b0bdbb None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.602557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf38b-ee45-47da-b2e6-7be1b9b0bdbb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.602557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf38b-ee45-47da-b2e6-7be1b9b0bdbb None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.603993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 241/473] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:55.607961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf38b-ee45-47da-b2e6-7be1b9b0bdbb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.622024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceebc59-df05-4a46-86b3-303dae9aa7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:55.622692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceebc59-df05-4a46-86b3-303dae9aa7dc None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.622971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceebc59-df05-4a46-86b3-303dae9aa7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.623231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceebc59-df05-4a46-86b3-303dae9aa7dc None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.623948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceebc59-df05-4a46-86b3-303dae9aa7dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:55.625415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceebc59-df05-4a46-86b3-303dae9aa7dc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:55.653037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 233/474] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:55 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:59:55.653037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f3a5-f665-4094-b60d-154c878c9a89 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.653037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f3a5-f665-4094-b60d-154c878c9a89 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.653037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61f3a5-f665-4094-b60d-154c878c9a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.678407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7a61f3a5-f665-4094-b60d-154c878c9a89 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:55.679733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7a61f3a5-f665-4094-b60d-154c878c9a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:55.771585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf38b-ee45-47da-b2e6-7be1b9b0bdbb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.777925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 234/475] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:55.803135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:55.812584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f3a5-f665-4094-b60d-154c878c9a89 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.826418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:55.827151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.827440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.827719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.828558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:55.828881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:55.830321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:55.853959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 242/476] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:55.860232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:55.920411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:55.928758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61f3a5-f665-4094-b60d-154c878c9a89 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.966847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:55.967526 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:55.967806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:55.968076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:55.968967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:55.970339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:55.977697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.sql.core [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 20:59:55.977697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 20:59:55.977697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [parameters: {'id': 'b85e693cac904c7085d54f3731aaf5cf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 20:59:55.977697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80415) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 20:59:55.982147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6399d-5565-4b7b-956f-98cbe63b30d4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result.read() Jun 16 20:59:55.997180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:59:55.998071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application yield resource Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise self.value Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application session.commit() Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 20:59:55.998967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.session.flush() Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application compat.raise_( Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 20:59:55.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:59:56.001534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result.read() Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:59:56.002310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [parameters: {'id': 'b85e693cac904c7085d54f3731aaf5cf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:56.003079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 20:59:56.003858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:56.010020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 235/477] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 16 20:59:55 2022] POST /identity/v3/roles => generated 144 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:56.010020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:56.024357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:56.025085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:56.025371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:56.025648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:56.026489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:56.030290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:56.054685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 243/478] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 20:59:55 2022] POST /identity/v3/users => generated 249 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:59:56.121147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba1fd-4d2f-4d0c-861f-17f30fbcfde8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:56.160260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffca24-ac05-4a8c-99f4-32ec481637f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:56.161101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffca24-ac05-4a8c-99f4-32ec481637f4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:56.161376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffca24-ac05-4a8c-99f4-32ec481637f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:56.161647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffca24-ac05-4a8c-99f4-32ec481637f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:56.177080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffca24-ac05-4a8c-99f4-32ec481637f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-19ffca24-ac05-4a8c-99f4-32ec481637f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:56.186261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:56.188417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:56.190345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 236/479] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 20:59:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:59:56.201373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:56.273733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:56.340557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e95b04-d3de-4d15-a366-7fd406d802ea None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:56.378465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c71bf-5cfb-4da6-92fc-8697965e79cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:56.379451 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c71bf-5cfb-4da6-92fc-8697965e79cf None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:56.379926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c71bf-5cfb-4da6-92fc-8697965e79cf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:56.380417 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c71bf-5cfb-4da6-92fc-8697965e79cf None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:56.381384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c71bf-5cfb-4da6-92fc-8697965e79cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:56.381878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c71bf-5cfb-4da6-92fc-8697965e79cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:56.383441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c71bf-5cfb-4da6-92fc-8697965e79cf None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:56.392145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 244/480] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 20:59:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:57.846236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e81e-a70d-4db0-b691-c2828920c6cc None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:57.847247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e81e-a70d-4db0-b691-c2828920c6cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:57.847723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed81e81e-a70d-4db0-b691-c2828920c6cc None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:57.849830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 237/481] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:57.855943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aa89d-dba2-4693-b0ba-e3a62c070fc0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:57.856841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aa89d-dba2-4693-b0ba-e3a62c070fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:57.857329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8aa89d-dba2-4693-b0ba-e3a62c070fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:57.879452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ab8aa89d-dba2-4693-b0ba-e3a62c070fc0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:57.880990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ab8aa89d-dba2-4693-b0ba-e3a62c070fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:57.982497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 245/482] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:58.018310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81e81e-a70d-4db0-b691-c2828920c6cc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:58.039120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:58.124633 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed81e81e-a70d-4db0-b691-c2828920c6cc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:58.158628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:58.159417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.159695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.159963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.170632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:58.178538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:58.179456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:58.180262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 238/483] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 20:59:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:58.185542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8aa89d-dba2-4693-b0ba-e3a62c070fc0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:58.224697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:58.317092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8aa89d-dba2-4693-b0ba-e3a62c070fc0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:58.363979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662cf5b-d189-425d-bcff-3c8eb4341f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:58.365055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662cf5b-d189-425d-bcff-3c8eb4341f34 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.365564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662cf5b-d189-425d-bcff-3c8eb4341f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.366036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662cf5b-d189-425d-bcff-3c8eb4341f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.366994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662cf5b-d189-425d-bcff-3c8eb4341f34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:58.367513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662cf5b-d189-425d-bcff-3c8eb4341f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:58.369145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9662cf5b-d189-425d-bcff-3c8eb4341f34 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:58.382820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 246/484] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 20:59:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:58.388489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:58.503881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414450e-cf57-4307-8b35-863dae884663 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.504242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414450e-cf57-4307-8b35-863dae884663 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.504491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414450e-cf57-4307-8b35-863dae884663 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.506098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 247/485] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:58.522323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:58.522509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2d8b4-a379-41f9-bdce-78f411a3e993 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.523121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2d8b4-a379-41f9-bdce-78f411a3e993 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.523416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2d8b4-a379-41f9-bdce-78f411a3e993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.545883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d84f-a786-4bfd-8d64-fa8f2aa416b1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:58.565389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4ff2d8b4-a379-41f9-bdce-78f411a3e993 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:58.566651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4ff2d8b4-a379-41f9-bdce-78f411a3e993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:58.583812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:58.584664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.584947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.585223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.603767 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:58.605955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:59:58.625559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:58.626482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:58.627317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:59:58.627317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:59:58.627317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:58.627317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:58.627317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 239/486] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:58.633222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:58.695612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 248/487] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:59:58.697439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe76d-e081-40f6-b34b-426d5944c0d6 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.698310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe76d-e081-40f6-b34b-426d5944c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.698777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe76d-e081-40f6-b34b-426d5944c0d6 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.705266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 249/488] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:58.706935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8077-1d49-4888-833e-cc018e36c558 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.707226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8077-1d49-4888-833e-cc018e36c558 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.707504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8077-1d49-4888-833e-cc018e36c558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.725039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-039d8077-1d49-4888-833e-cc018e36c558 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:58.726236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-039d8077-1d49-4888-833e-cc018e36c558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:58.747813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:58.763289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9b93b-e4ac-471d-9aed-9ae2c0745ba5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:58.794489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:58.801099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:58.802011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.802501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.802993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.803986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:58.804576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:58.806126 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:58.818316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 250/489] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:58.819377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8077-1d49-4888-833e-cc018e36c558 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:58.821244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 240/490] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:58.836196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:58.940186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8077-1d49-4888-833e-cc018e36c558 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:58.945439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005baf6-0ec0-4a5b-9fae-0f2350723506 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:58.986658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:58.987464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.987748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.988022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:58.989675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa0d8c-936f-4720-9e81-7cf6132a31cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:58.990471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0d8c-936f-4720-9e81-7cf6132a31cc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:58.990750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0d8c-936f-4720-9e81-7cf6132a31cc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:58.991024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa0d8c-936f-4720-9e81-7cf6132a31cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.002459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa0d8c-936f-4720-9e81-7cf6132a31cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.003945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa0d8c-936f-4720-9e81-7cf6132a31cc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.008139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:59.017007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:59.018000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:59.018784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 251/491] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 20:59:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:59.019523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5daa0d8c-936f-4720-9e81-7cf6132a31cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:59:59.021177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:59.022042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:59:59.023199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:59.026570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 241/492] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 20:59:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:59.026570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637d49-65a3-4f00-95a0-0445893247c3 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.026570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637d49-65a3-4f00-95a0-0445893247c3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.026570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637d49-65a3-4f00-95a0-0445893247c3 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.027965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 242/493] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:59.029110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061030c7-83f7-486f-b4ee-9686803dc508 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.029372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061030c7-83f7-486f-b4ee-9686803dc508 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.029647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061030c7-83f7-486f-b4ee-9686803dc508 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.030986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 243/494] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 20:59:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:59:59.031684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061030c7-83f7-486f-b4ee-9686803dc508 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.034774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.083499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.120872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a8f5d-74b1-480c-a639-a19d25265ed7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.132386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061030c7-83f7-486f-b4ee-9686803dc508 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.154250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.155048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.155341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.155609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.165582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16871274-dfe2-41c5-b56f-08e74a9725fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.165738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:59.166232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871274-dfe2-41c5-b56f-08e74a9725fe None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.166558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871274-dfe2-41c5-b56f-08e74a9725fe None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.166785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16871274-dfe2-41c5-b56f-08e74a9725fe None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.168329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871274-dfe2-41c5-b56f-08e74a9725fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:59.168748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871274-dfe2-41c5-b56f-08e74a9725fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.170116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16871274-dfe2-41c5-b56f-08e74a9725fe None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:59.174021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:59.174974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:59.175768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 252/495] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:59.176462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.180775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 244/496] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:59.181286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f8d6-b209-4753-ac01-e52d6ae0c97e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.181570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f8d6-b209-4753-ac01-e52d6ae0c97e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.181846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0f8d6-b209-4753-ac01-e52d6ae0c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.197775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-80d0f8d6-b209-4753-ac01-e52d6ae0c97e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:59.199417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-80d0f8d6-b209-4753-ac01-e52d6ae0c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:59.246173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.263779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 245/497] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:59.265010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f466-0ab4-4243-b10e-bd056f519610 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.265303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f466-0ab4-4243-b10e-bd056f519610 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.265578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5f466-0ab4-4243-b10e-bd056f519610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.285181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2ec5f466-0ab4-4243-b10e-bd056f519610 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:59:59.286395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126388af-d936-4d93-8e01-d96bb0784398 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.286668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2ec5f466-0ab4-4243-b10e-bd056f519610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:59:59.319863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.320572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.320863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.321124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.321235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.321961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:59.322316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.324491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.353883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 246/498] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 20:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:59:59.354699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5f466-0ab4-4243-b10e-bd056f519610 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.365347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 253/499] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:59.365347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.465843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5f466-0ab4-4243-b10e-bd056f519610 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.466416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a40464-86a6-4c2f-aabc-e4b570c1e750 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.494281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.499385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.500045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.500362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.500630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.501363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:59.501455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.501666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.502211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.502493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.502768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.503043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.511822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 247/500] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:59:59.512582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.513537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.515094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:59:59.532499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:59.533354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:59.534167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:59:59.534167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:59:59.534167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:59.534167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 20:59:59.534167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 254/501] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:59.534443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.547476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.618929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb06146-43cf-433f-b639-2293fa6bee0f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.633512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8817f-8649-4767-a3ab-223feee01fb1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.655933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.656755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.657031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.657304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.668822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.669109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.669358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.669642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.669920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.670466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:59:59.687755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:59.688751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:59.689563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:59:59.689563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:59:59.689563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:59:59.689563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:59.689563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 248/502] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:59.689833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.722341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.741952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.743414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.781919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.799886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04710161-a70c-4e6e-a3b3-c3a62f35eb29 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.833019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.833812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.834100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.834374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.843885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 255/503] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:59:59.844756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.844861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:59:59.853026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:59:59.853930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 20:59:59.854730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 249/504] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:59:59.856120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:59:59.925348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:59:59.945355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f60e6-a3db-4b36-ba6d-b1f110b019c5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.952790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead9ff-807a-49b1-a263-3508e73b862f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:59:59.982293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.983095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.983376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.983642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.986353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:59:59.987089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:59:59.987588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:59:59.987966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:59:59.988727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:59:59.989038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.990437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:59:59.993544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:59:59.994977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.002559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 250/505] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:00.003353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.013223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:00.016472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:00.017392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:00.018230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:00.018230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:00.018230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:00.018230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:00.018230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 256/506] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 20:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:00.018483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.111175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509aae0-107a-4b82-bf84-7d88dd71fe88 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.117325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7dbec-2498-4927-9b8f-d13533065b01 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.145493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.146152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.146433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.146716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.147428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:00.147743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.149149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.151187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.152977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.153262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.153537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.155499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.161750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 251/507] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:00.162612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.164303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.165748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:00.183880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:00.184791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:00.185609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:00.185609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:00.185609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:00.185609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:00.185609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 257/508] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:00.185875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.230866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.266182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8eb93-3c15-4bf0-bed5-fb473de911a7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.284931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37ebea-7f1d-4408-9e14-07d9fd468507 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.299435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.300097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.300407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.300681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.301419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:00.301721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.303101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.311373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 252/509] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:00.312143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.324005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.325043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.325328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.325601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.332576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.334019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:00.350484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:00.351392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:00.352336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 258/510] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:00.352896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.399747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.413819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcb50f-9d7a-4171-beb6-a64104378c61 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.439655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.447978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.448718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.449009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.449288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.450011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:00.450321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.451699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.454824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507686a-f9d8-41f1-96c2-1758f0b1251b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.463550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 253/511] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:00.465052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.493638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.494308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.494599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.494878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.496153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.497920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.518390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 259/512] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 21:00:00 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:00.519137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.586882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bc500-ffd3-42d9-b4ff-de05cf18a35c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.628149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.628864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.629175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.629453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.630195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:00.630523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.631913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.646114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 254/513] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:00.646991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.655473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d47a69-2af0-47df-85a2-01672b3f0b39 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.658295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.702098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.703878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.703878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.703878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.706385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.717895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.718966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:00.741485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:00.742553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:00.743611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:00.743611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:00.743611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:00.743611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:00.743611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 260/514] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:00.743611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.771615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644406ab-1737-43cf-85e7-fa6734b52970 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.807244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.807997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.808362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.808656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.809488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:00.809794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.811217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.850216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 255/515] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:00.851063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.858868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c42ff-7e82-4faf-9d3f-54662cb8bfeb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.902494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:00.903558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:00.903840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:00.904134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:00.912860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:00.914305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:00.928452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:00.929363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 261/516] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:00.936007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:00.951132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:00.964884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232c4d3-737d-4aeb-83bf-81e66d737280 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:00.973680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.004836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.005853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.006306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.006776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.014630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.016309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:01.032427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:01.033289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:01.034146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 256/517] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:01.034621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.045447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08719a-45aa-4f55-8d5e-481807f095ac None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.081976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.082647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.082925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.083200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.083918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:01.084257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.085628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.102354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 262/518] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:01.102354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.150499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d2c0-b8b9-4fe2-9858-381e7ad8301c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.178607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.188027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.188706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.188991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.189267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.205520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ff071-c526-4c5c-84dd-0858ca2b4444 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.225225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.242313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.242983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.243260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.243532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.244383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:01.244688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.246779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.264220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 263/519] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:01.265064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.270180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.271815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.371084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29411c-6591-4478-a0fb-729503d9c5e1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.386849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 257/520] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:01.388012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.400723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.407130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.407806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.408090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.408398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.409192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:01.409503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.410963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.429541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 264/521] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:01.430359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.462354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.502903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414ef45-9bdf-4621-8026-6ce831526ed1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.540402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.541208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.541493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.541787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.544152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb8286-d343-4c57-b424-56edb60596be None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.549726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.551197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:01.566056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:01.566940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:01.567822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 258/522] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:01.568401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.581826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.582476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.582755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.583028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.646329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.658514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.660330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.688641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624c52e-6806-4ae0-81f7-0ae029a0435e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.720199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.727747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.728577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.728865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.729144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.739687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.741181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:01.759864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:01.760973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:01.762052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:01.762052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:01.762052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:01.762052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:01.762052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 259/523] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:01.762532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.778919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 265/524] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:01.780039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.876118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ef56-780f-4456-873f-8e03d47d48fc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.885589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:01.896098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f2def8-bb72-45cb-a910-85f053bf5ec3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:01.913866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.914456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.914738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.915012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.915970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=4fd5a266491c487385349368b5ccbbc1) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:01.916336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.918119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.932217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 260/525] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/role_assignments?user.id=4fd5a266491c487385349368b5ccbbc1&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:01.932217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.942811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:01.943808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:01.944104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:01.944428 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:01.945575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:01.946326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:01.947889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:01.976346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 266/526] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:01.977257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:01.980908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:02.052522 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131827c7-055b-466d-8580-5e1bae220acc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.092861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.093706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.094091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.094469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.095311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:02.095724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.097272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.112343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 261/527] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:02.113335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.140952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830b5f-70a9-4af8-a4f5-8405b4628a8d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.191160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.192284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.192641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.192990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.207696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.210067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.232960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc35dc-67b4-4a0b-9be4-35ce8e332184 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.234931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:02.237977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:02.238856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:02.240493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:02.240493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:02.240493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:02.240493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:02.240493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 267/528] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:02.240776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.252550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:02.288285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.289100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.289463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.289748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.362344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd24036-720b-4f4d-bded-c357c3958223 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.389715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.391886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.403041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.404204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.404695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.405173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.414455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.415916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:02.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:02.432680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:02.434463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 268/529] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:02.435390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.506509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:02.538684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 262/530] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:02.540131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.544689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:02.554925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6ac283-ae3b-4976-90eb-ebb161ab6b15 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.606536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.607335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.607719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.608095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.608966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:02.609378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.610879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.624508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 269/531] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:02.625604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.681882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4fbe6-e6d0-4eb9-9065-5e7404f05a76 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.734593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.735283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.735575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.735837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.736661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:02.736976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.738430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.744608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa3db-ce9b-4ae8-9403-01b1823612c3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.759108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 263/532] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:02.759875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.777853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:02.790877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb63aa-237e-4fe4-bc2a-555f777fbef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.791707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb63aa-237e-4fe4-bc2a-555f777fbef0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.791991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb63aa-237e-4fe4-bc2a-555f777fbef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.792414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb63aa-237e-4fe4-bc2a-555f777fbef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.803437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb63aa-237e-4fe4-bc2a-555f777fbef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.805321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb63aa-237e-4fe4-bc2a-555f777fbef0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-c5eb63aa-237e-4fe4-bc2a-555f777fbef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:02.824472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:02.825406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:02.826235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:02.826235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:02.826235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:02.826235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:02.826235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 270/533] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:02.827017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eace32-abb7-43be-9bed-eb28b05ac2d9 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.827306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eace32-abb7-43be-9bed-eb28b05ac2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.827582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eace32-abb7-43be-9bed-eb28b05ac2d9 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.832210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 271/534] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:02.832210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eace32-abb7-43be-9bed-eb28b05ac2d9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.832395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:02.874947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d25a2-1453-411a-9037-8118c9c1c058 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.911320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.912397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.912859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.913337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.920745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.922177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:02.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:02.937719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:02.938551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 264/535] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:02.939506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:02.943578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eace32-abb7-43be-9bed-eb28b05ac2d9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:02.978678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c384d7-4870-4a22-9c99-da19e43d12f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:02.979312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c384d7-4870-4a22-9c99-da19e43d12f7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.979593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c384d7-4870-4a22-9c99-da19e43d12f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.980425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c384d7-4870-4a22-9c99-da19e43d12f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:02.981311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c384d7-4870-4a22-9c99-da19e43d12f7 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=c1e4d798757a41cfad3454940c12bcab) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:02.981625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c384d7-4870-4a22-9c99-da19e43d12f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:02.983339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c384d7-4870-4a22-9c99-da19e43d12f7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:02.988832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 272/536] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/role_assignments?user.id=c1e4d798757a41cfad3454940c12bcab&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:02.990002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776b27-b853-4e69-ac7b-9e0b702b328d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:02.990286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776b27-b853-4e69-ac7b-9e0b702b328d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:02.990560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37776b27-b853-4e69-ac7b-9e0b702b328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.023049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-37776b27-b853-4e69-ac7b-9e0b702b328d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:03.024524 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-37776b27-b853-4e69-ac7b-9e0b702b328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:03.081535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:03.085549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d78bdc-d08f-4661-ba74-2bea959faef9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:03.117317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:03.134122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 273/537] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:03.134630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:03.135154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776b27-b853-4e69-ac7b-9e0b702b328d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:03.135818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:03.136830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:03.137952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.139103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:03.140529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:03.142128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:03.159764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 265/538] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:03.167732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:03.269376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37776b27-b853-4e69-ac7b-9e0b702b328d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:03.308510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:03.309264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bcf68-677d-4455-be74-41693b0dcd5d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:03.309361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:03.309602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:03.309777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.310557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:03.310865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:03.312337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:03.329177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 274/539] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:03.330050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:03.352638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:03.353624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:03.353915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:03.354704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.361961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:03.366097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:03.368946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:03.391175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:03.392077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:03.392930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:03.396280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 266/540] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:03.397131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:03.444749 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:03.469188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13f80-1e9c-4b42-b49d-ca8d112ee60f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:03.510081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:03.510880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:03.511812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:03.512751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.515399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8d4c0-dd0e-42bf-9aaa-189244d55c05 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:03.529810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:03.538424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:03.539313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:03.540093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 275/541] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:03.545699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:03.554980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:03.556400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:03.556978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:03.557788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.559478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=35b6a283856448d9aca6f50a3d58742f) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:03.560313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:03.562231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:03.576847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 267/542] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/role_assignments?user.id=35b6a283856448d9aca6f50a3d58742f&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:03.576847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:03.720336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:03.751793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b6930-b469-45a3-826c-c0ffeb07a44c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:03.791085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759f297-a9ff-4238-b289-47f7426fad86 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:03.802268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:03.806491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:03.807690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:03.808373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:03.808657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.810300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:03.810627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:03.812536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:03.831546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 276/543] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:03.838201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:03.849481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:03.850951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:03.851845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:03.852383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:03.853605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:03.854139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:03.857083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:03.874903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 268/544] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:03.880263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:04.021281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a94e7a-5145-4655-a23e-86757e8ab3cf None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:04.052599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e0030-99c4-4328-95e5-1dba650f0084 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:04.092881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:04.093888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.094388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.094863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.095889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=d9ea56567eeb4392b5f9e5c84f16f413) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:04.096544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:04.099402 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:04.112577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 277/545] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/role_assignments?user.id=d9ea56567eeb4392b5f9e5c84f16f413&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:04.119026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab68c00-5b18-451d-8fc1-75aff24d9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:04.121429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68c00-5b18-451d-8fc1-75aff24d9796 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.122025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68c00-5b18-451d-8fc1-75aff24d9796 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.122506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab68c00-5b18-451d-8fc1-75aff24d9796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.135610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab68c00-5b18-451d-8fc1-75aff24d9796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:04.137582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab68c00-5b18-451d-8fc1-75aff24d9796 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9ab68c00-5b18-451d-8fc1-75aff24d9796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:04.158155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:04.159064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:04.159893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:04.159893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:04.159893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:04.159893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:04.162334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 269/546] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:04.169321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:04.193383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:04.195599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599905-b10a-4ec2-92e7-59c1a0fe218a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.196153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599905-b10a-4ec2-92e7-59c1a0fe218a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.196672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df599905-b10a-4ec2-92e7-59c1a0fe218a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.199743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 270/547] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:04.205363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008159d8-83a2-41e4-a3fc-b1f84645727b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.205959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008159d8-83a2-41e4-a3fc-b1f84645727b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.206466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008159d8-83a2-41e4-a3fc-b1f84645727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.240557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-008159d8-83a2-41e4-a3fc-b1f84645727b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:04.242150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-008159d8-83a2-41e4-a3fc-b1f84645727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:04.272014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:04.331127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01047b9-9525-4e27-90e3-db34e36bf053 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:04.364705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 271/548] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 21:00:04.380897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:04.381902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.382388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.382884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.383842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:04.384372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:04.386809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:04.387709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008159d8-83a2-41e4-a3fc-b1f84645727b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:04.399835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 278/549] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:04.409193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:04.549766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:04.574010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008159d8-83a2-41e4-a3fc-b1f84645727b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:04.615451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:04.616200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.616501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.616777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.618091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97839c-d95b-4a51-9176-abedc1ee0bfc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:04.629155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:04.639516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:04.640943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:04.641908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 272/550] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:04.649149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:04.662858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:04.702632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:04.703442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.703724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.704002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.713108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:04.715759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:04.733425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:04.734381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:04.735447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 279/551] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:04.742935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:04.864724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31988412-fd41-4f83-9e72-7704a0cffde4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:04.882380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2010dd-c128-44c1-a8ea-ea9b9fcfb0e9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:04.900796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:04.909013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:04.910207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.910639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.910926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.911775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:04.912086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:04.913545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:04.935812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 280/552] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 16 21:00:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:04.941192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:04.997838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:04.998534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:04.998812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:04.999079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:04.999831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:05.000132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:05.001533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:05.018718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 273/553] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:05.025281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:05.090921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8b1495-4a14-42ff-9441-be07e97929c9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:05.140283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:05.140283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:05.140283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:05.140881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:05.212969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:05.225815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:05.227539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:05.233195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:05.336251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 281/554] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 21:00:05.342807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:05.388352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb4dfd-432f-470b-8c16-6f2dc34c60a3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:05.488879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:05.502388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e0f74-6a09-4e34-a742-0ff78a987d35 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:05.528441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedcd42-6ec5-4bf3-a472-37fe9b88de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:05.529353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcd42-6ec5-4bf3-a472-37fe9b88de5d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:05.529636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcd42-6ec5-4bf3-a472-37fe9b88de5d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:05.529907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedcd42-6ec5-4bf3-a472-37fe9b88de5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:05.550658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedcd42-6ec5-4bf3-a472-37fe9b88de5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:05.552530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e7e77-fa97-4e45-bbee-80e9b500947f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:05.552681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedcd42-6ec5-4bf3-a472-37fe9b88de5d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:05.554566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e7e77-fa97-4e45-bbee-80e9b500947f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:05.556300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e7e77-fa97-4e45-bbee-80e9b500947f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:05.557064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e7e77-fa97-4e45-bbee-80e9b500947f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-baedcd42-6ec5-4bf3-a472-37fe9b88de5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:05.573743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:05.574675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:05.575529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:05.575529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:05.575529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:05.575529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:05.575751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 274/555] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 551 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:05.577079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850618cd-b63a-4bd5-8357-43fd75350287 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:05.577352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850618cd-b63a-4bd5-8357-43fd75350287 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:05.577763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850618cd-b63a-4bd5-8357-43fd75350287 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:05.580621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e7e77-fa97-4e45-bbee-80e9b500947f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:05.582347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e7e77-fa97-4e45-bbee-80e9b500947f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:05.583061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 275/556] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:05.583865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850618cd-b63a-4bd5-8357-43fd75350287 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f41e7e77-fa97-4e45-bbee-80e9b500947f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:05.607381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:05.608240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:05.609591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:05.609591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:05.609591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:05.609591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:05.611371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 282/557] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:05.612738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb49c19-fb52-42ad-b4e7-576fdb851fc9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:05.613023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb49c19-fb52-42ad-b4e7-576fdb851fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:05.613298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb49c19-fb52-42ad-b4e7-576fdb851fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:05.649079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2fb49c19-fb52-42ad-b4e7-576fdb851fc9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:05.650140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2fb49c19-fb52-42ad-b4e7-576fdb851fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:05.712785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850618cd-b63a-4bd5-8357-43fd75350287 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:05.741112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:05.755764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:05.756890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:05.757442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:05.757985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:05.758906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:05.759408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:05.761269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:05.780294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 276/558] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:05.781497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:05.844290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 283/559] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:05.845131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb49c19-fb52-42ad-b4e7-576fdb851fc9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:05.896333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a143b-81cb-4e09-b0c2-92e112458713 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:05.933616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:05.934867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:05.935786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:05.936291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:05.936768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:05.937677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:05.938148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:05.940464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:05.953938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 277/560] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:05.955196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:05.970174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb49c19-fb52-42ad-b4e7-576fdb851fc9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.015676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:06.018292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.019634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.020471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.020971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.030978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.033422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:06.058113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:06.059096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 21:00:06.060013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:06.067326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 284/561] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:06.068666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.081471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad253e-1c52-46fe-9ade-4bc8c5694a8d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.132333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.133614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.133992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.134361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.149317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:06.159779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:06.161041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:06.162049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:06.169703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 278/562] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:06.170717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.198170 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef6579-f485-4915-9769-3c61c7e1b325 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.232375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:06.238138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.238938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.239218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.239492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.246556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.248110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:06.261970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:06.262879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:06.263740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:06.267752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 285/563] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:06.268488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.286045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f87a3-da0b-4b1b-90ad-881303c9f006 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.289651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:06.324568 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b463a6f-105a-4107-b8e4-8081c76a86d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.325237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463a6f-105a-4107-b8e4-8081c76a86d7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.325515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463a6f-105a-4107-b8e4-8081c76a86d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.325788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463a6f-105a-4107-b8e4-8081c76a86d7 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.326611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b463a6f-105a-4107-b8e4-8081c76a86d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:06.326919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b463a6f-105a-4107-b8e4-8081c76a86d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.328382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b463a6f-105a-4107-b8e4-8081c76a86d7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.347099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 279/564] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:06.348844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d452-c63e-464d-8cc7-f3fa091d8571 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.349233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d452-c63e-464d-8cc7-f3fa091d8571 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.349512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54d452-c63e-464d-8cc7-f3fa091d8571 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.353792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 280/565] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:06.353792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d452-c63e-464d-8cc7-f3fa091d8571 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.381605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142df3e-b281-4971-9bf3-a588702bcf62 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.419520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.420204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.420495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.420892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.421625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:06.422044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.423400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.432014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 286/566] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:06.433595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.463537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54d452-c63e-464d-8cc7-f3fa091d8571 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.494139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:06.502867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d8be6-397e-47a1-821a-33f77e27a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.503835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d8be6-397e-47a1-821a-33f77e27a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.504341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d8be6-397e-47a1-821a-33f77e27a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.504615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d8be6-397e-47a1-821a-33f77e27a9f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.505440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d8be6-397e-47a1-821a-33f77e27a9f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:06.505758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d8be6-397e-47a1-821a-33f77e27a9f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.507251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d8be6-397e-47a1-821a-33f77e27a9f8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.523119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 281/567] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:06.524523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619f69-fea3-4183-99c2-2d35e0d24565 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.524818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619f69-fea3-4183-99c2-2d35e0d24565 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.525098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90619f69-fea3-4183-99c2-2d35e0d24565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.543930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-90619f69-fea3-4183-99c2-2d35e0d24565 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:06.545196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-90619f69-fea3-4183-99c2-2d35e0d24565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:06.563399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:06.565667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3710-be9b-421d-a47e-3f23dbf0ffdb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.601725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.602529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.602810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.603162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.614961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.616442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.617227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 282/568] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:06.618072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90619f69-fea3-4183-99c2-2d35e0d24565 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:06.634525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:06.635396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:06.636776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:06.636776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:06.636776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:06.636776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:06.639049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 287/569] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:06.639935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.716108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90619f69-fea3-4183-99c2-2d35e0d24565 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.737609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c607c9-bce6-4917-a5aa-a38bd6dd6287 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.744226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:06.749491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf931d2-3375-4c8a-b7a9-afcf70966e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.750285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf931d2-3375-4c8a-b7a9-afcf70966e3a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.750571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf931d2-3375-4c8a-b7a9-afcf70966e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.750851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf931d2-3375-4c8a-b7a9-afcf70966e3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.762354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf931d2-3375-4c8a-b7a9-afcf70966e3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.763817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf931d2-3375-4c8a-b7a9-afcf70966e3a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.773963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.774553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.774831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.775103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.775936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=759ce183ee164679ba3d16860c088804) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:06.776277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.777769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ccf931d2-3375-4c8a-b7a9-afcf70966e3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:06.781588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:06.782503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:06.793501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:06.793501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:06.793501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:06.793501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:06.793501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 283/570] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:06.793919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 288/571] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/role_assignments?user.id=759ce183ee164679ba3d16860c088804&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:06.794043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90b6d-ad73-445e-aa6f-91fee53c6678 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.794129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.794210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90b6d-ad73-445e-aa6f-91fee53c6678 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.794210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc90b6d-ad73-445e-aa6f-91fee53c6678 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.794210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 284/572] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:06.794210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc90b6d-ad73-445e-aa6f-91fee53c6678 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.797258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:06.909995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a32b-eb8f-4c53-af6a-07924b59b838 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.910396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc90b6d-ad73-445e-aa6f-91fee53c6678 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:06.952008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dccbf3-6c84-4b86-8a68-9c57323cefd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.952874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dccbf3-6c84-4b86-8a68-9c57323cefd7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.953158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dccbf3-6c84-4b86-8a68-9c57323cefd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.953429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:06.953544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dccbf3-6c84-4b86-8a68-9c57323cefd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.954096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.954379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.954652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:06.955497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:06.955807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:06.957226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:06.969862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 285/573] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:06.970789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:06.977349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dccbf3-6c84-4b86-8a68-9c57323cefd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-99dccbf3-6c84-4b86-8a68-9c57323cefd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:06.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:06.987213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:06.988025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 289/574] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:06.989227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc1cf-13bb-4d49-be67-f5330dc5faf1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:06.989227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc1cf-13bb-4d49-be67-f5330dc5faf1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:06.989348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc1cf-13bb-4d49-be67-f5330dc5faf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.006173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-38fbc1cf-13bb-4d49-be67-f5330dc5faf1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:07.007359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-38fbc1cf-13bb-4d49-be67-f5330dc5faf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:07.036255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.046771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.096194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 290/575] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:07.096194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc1cf-13bb-4d49-be67-f5330dc5faf1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.096496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f92b83-5674-485e-844d-6dcd1558fbe3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.131222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.132031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.132392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.132751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.133548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:07.133865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.135252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.147629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 286/576] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:07.148306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.215487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc1cf-13bb-4d49-be67-f5330dc5faf1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.251608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.252691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.253116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.253544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.260813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.262670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.271830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c8fd4-6f03-4d65-b261-6976a622d362 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:07.278313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:07.279333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:07.280433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:07.282471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 291/577] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:07.283437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.302871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.307596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.318634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.319299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.319576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.319846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.320618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:07.320923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.322522 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.335529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 287/578] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:07.335529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.398845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b8f62-82cd-4dcc-a26f-77e91bbfce06 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.439916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b581-a1e1-44d3-8ecc-ace4f26ab291 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.441709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.442640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.443024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.443403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.454401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:07.462435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:07.463568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:07.464658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:07.470271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 292/579] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:07.470271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.485950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.487053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.487436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.487719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.497812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.499277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:07.513863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:07.514980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:07.516085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:07.519690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 288/580] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:07.520613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.555963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.571955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.580371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb8123-1134-46ae-8791-12e7685cd584 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.619901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.620708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.621016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.621250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.622032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:07.622347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.623781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.636945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 293/581] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:07.637684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.643824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2925b-223e-4567-a03d-4e1221d42e0e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.678742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.679531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.679819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.680096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.691013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.692504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:07.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:07.714747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:07.715799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:07.715799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:07.715799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:07.715799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:07.717353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 289/582] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:07.718260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.749913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2400e-2e11-4938-ba88-7bd26e7fc631 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.785528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.786422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.786845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.787281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.788159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:07.788631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.790123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.799351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 294/583] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:07.800326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.806182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.831537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:07.837457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f5c3-4d09-41b0-b798-978b4dc413a2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.877806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.878577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.878934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.879283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.880215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:07.880603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.882109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.905362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 290/584] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:07.905362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:07.917682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977619be-38f4-4a5d-bd08-6a59b77752e1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:07.953690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:07.954681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:07.955055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:07.955406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/4fd5a266491c487385349368b5ccbbc1/roles/744abd0f005f43e8bc93a7267c81c7bd` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:07.975369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=4fd5a266491c487385349368b5ccbbc1, role_id=744abd0f005f43e8bc93a7267c81c7bd)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:07.976963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:07.991677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 295/585] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:07 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/4fd5a266491c487385349368b5ccbbc1/roles/744abd0f005f43e8bc93a7267c81c7bd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:07.992753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.020675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f6e64-c47a-4c9f-a256-852c6a5b8c6e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.068498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.069194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.069543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.069887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.070741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:08.071113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.072670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.085134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:08.087361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 291/586] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:08.088479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.111111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:08.148538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a95f5-7176-444f-bfcd-329b225defdd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.185541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.186400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.186780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.187148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.201725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.203338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.218374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2766b5-de17-4153-a94c-ed8b572fb11b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:08.222677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:08.224369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:08.225292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:08.225292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:08.225292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:08.225292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:08.225292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 296/587] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:08.229010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.274720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.276407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.277759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.278598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.294442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.297111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:08.325215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:08.326545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:08.327417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:08.327417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:08.327417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:08.327417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:08.330164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 292/588] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:08.335015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.348876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84944c62-54b1-4136-9414-7c9e37868072 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.352526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:08.398056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.399804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.400438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.400979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.408494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:08.411752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.414551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:08.437076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:08.438294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:08.439542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:08.443185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 297/589] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:08.444839 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.450427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cba802-959d-4ebc-a3de-253f8f49bbcf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.499513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.501075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.501631 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.502069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.503215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:08.504078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.505652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.528256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 293/590] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:08.528256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.570799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57959a2c-2428-46a1-81d4-85228934fab7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.622094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.623406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.624537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.624817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.625563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:08.625869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.627249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.641270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 298/591] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:08.642109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.668046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:08.673185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90771ddf-d8ee-44f0-b074-d6d8d4a67e2f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.711061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:08.723455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.724535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.725501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.726004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.727851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:08.728398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.730902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.754414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 294/592] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:08.755305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01662996-33c0-4f20-b2e5-15465617a08a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.755438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.808967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.810707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.811213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.811717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.821227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.822954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:08.838148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:08.839234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 21:00:08.840338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:08.847561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 299/593] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:08.849251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.866223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5e16a-5aaa-4728-8364-c6f291cd14c1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.904131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:08.904966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:08.905241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:08.905514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:08.912632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:08.914271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:08.928806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:08.929704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:08.930575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 295/594] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:08.931076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:08.949147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:08.967060 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561bf16-707c-441e-aac3-79c313dd5bca None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:08.985085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:09.003381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ddf5b-309e-40dc-b3ac-314e17cbc099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.004202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ddf5b-309e-40dc-b3ac-314e17cbc099 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.004488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ddf5b-309e-40dc-b3ac-314e17cbc099 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.004760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ddf5b-309e-40dc-b3ac-314e17cbc099 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.016010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ddf5b-309e-40dc-b3ac-314e17cbc099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.017502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ddf5b-309e-40dc-b3ac-314e17cbc099 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f28ddf5b-309e-40dc-b3ac-314e17cbc099 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:09.035683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:09.036612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:09.037478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:09.037478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:09.037478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:09.037478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:09.041570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 300/595] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:09.043335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceffa3-ff8a-4afa-9b09-31a668c5d719 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.043631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceffa3-ff8a-4afa-9b09-31a668c5d719 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.043920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceffa3-ff8a-4afa-9b09-31a668c5d719 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.045258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 301/596] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:09.045962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceffa3-ff8a-4afa-9b09-31a668c5d719 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.047294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3cc8d-91d8-4cd1-bc9c-1d7e9af0ee02 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.084494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.085432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.085776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.086047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.086871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:09.087176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.088636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.111245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 296/597] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jun 16 21:00:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:09.112132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.154561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceffa3-ff8a-4afa-9b09-31a668c5d719 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.190335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4069b81-a769-45fc-9910-6ed3a8d9b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.191020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069b81-a769-45fc-9910-6ed3a8d9b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.191300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069b81-a769-45fc-9910-6ed3a8d9b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.191575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4069b81-a769-45fc-9910-6ed3a8d9b5b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.193041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069b81-a769-45fc-9910-6ed3a8d9b5b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:09.193356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069b81-a769-45fc-9910-6ed3a8d9b5b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.195278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4069b81-a769-45fc-9910-6ed3a8d9b5b2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.198524 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:09.208780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 302/598] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:09.210103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b5b8-5296-45c1-a2bc-361a0bf73280 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.210392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b5b8-5296-45c1-a2bc-361a0bf73280 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.210668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245b5b8-5296-45c1-a2bc-361a0bf73280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.226541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0dbd-9ac9-4c13-ac37-678fa5c764a5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.228236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f245b5b8-5296-45c1-a2bc-361a0bf73280 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:09.229017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:09.229413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f245b5b8-5296-45c1-a2bc-361a0bf73280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:09.263976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.264675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.264957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.265238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.265970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:09.266279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.267655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.284237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 297/599] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:09.284237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.309351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 303/600] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:09.309351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245b5b8-5296-45c1-a2bc-361a0bf73280 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.394271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6d81-5224-4730-b95c-1937e91e9ba1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.418299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245b5b8-5296-45c1-a2bc-361a0bf73280 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.431963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.433453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.433837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.434249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.444793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:09.445351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.446969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.455960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.456790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.457069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.457338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/c1e4d798757a41cfad3454940c12bcab/roles/744abd0f005f43e8bc93a7267c81c7bd` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:09.464624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:09.465711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:09.466576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:09.466576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:09.466576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:09.466576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:09.466576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 298/601] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:09.466576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.476950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=c1e4d798757a41cfad3454940c12bcab, role_id=744abd0f005f43e8bc93a7267c81c7bd)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.479207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.485878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:09.504266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 304/602] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:09 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/c1e4d798757a41cfad3454940c12bcab/roles/744abd0f005f43e8bc93a7267c81c7bd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:09.504266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.601770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698c366-73fe-4038-94af-c87bcb7fb4cf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.647441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e394678-7749-4507-a463-d5a76521d9ef None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.649500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.651535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.652142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.652648 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.661981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.664081 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:09.685352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:09.686469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 299/603] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:09.687558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.700706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.701524 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.701807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.702091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.715930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:09.726790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:09.727907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:09.728935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:09.736300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 305/604] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:09.736300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.782332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:09.796564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:09.827699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c85be2-43fc-4489-bb21-3a61b724768a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.871531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.872412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa11da-dc4d-4060-945f-ba15f838f57a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:09.872696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.873115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.873573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.874590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:09.875048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.877416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.897021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 300/605] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:09.897207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:09.918267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:09.919342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:09.919919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:09.920436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:09.921466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:09.922004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:09.923807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:09.942953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 306/606] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:09.944264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.003908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074365ef-818e-4e04-87c5-243fd37f44a5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.039294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.039965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.040276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.040557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.041297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:10.041606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:10.043206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:10.045519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:10.056222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 301/607] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:10.056222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.061854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:10.068261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad075d1-065d-41d8-88f2-801b3058942b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.107178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.108415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.108913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.109381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.116605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:10.118294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:10.133557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:10.134453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:10.135389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:10.142272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 307/608] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:10.143403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.162695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d9259-4aec-4d7a-8c6e-f66fc9f12dd5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.199712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.200610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.200913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.201439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/35b6a283856448d9aca6f50a3d58742f/roles/744abd0f005f43e8bc93a7267c81c7bd` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.218847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=35b6a283856448d9aca6f50a3d58742f, role_id=744abd0f005f43e8bc93a7267c81c7bd)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:10.220384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:10.240214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 302/609] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:10 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/35b6a283856448d9aca6f50a3d58742f/roles/744abd0f005f43e8bc93a7267c81c7bd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:10.240214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.281205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a728a5f-46af-48c1-aed1-8fcf0a0534d0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.325910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:10.337435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a1309-13c6-42b8-bc21-ce84280d5d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.338590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1309-13c6-42b8-bc21-ce84280d5d9d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.338938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1309-13c6-42b8-bc21-ce84280d5d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.339255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a1309-13c6-42b8-bc21-ce84280d5d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.357245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a1309-13c6-42b8-bc21-ce84280d5d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:10.358759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a1309-13c6-42b8-bc21-ce84280d5d9d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-cc2a1309-13c6-42b8-bc21-ce84280d5d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:10.387159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:10.388090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:10.388994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:10.388994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:10.388994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:10.388994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:10.389210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 308/610] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:10.389704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9dce1-8a83-4365-800b-d5a062a5b54f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.390863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e357-fc8f-4c67-8426-2ac0942e713f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.390863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e357-fc8f-4c67-8426-2ac0942e713f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.390863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1e357-fc8f-4c67-8426-2ac0942e713f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.397546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 309/611] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:10.399067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1e357-fc8f-4c67-8426-2ac0942e713f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.415033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:10.434131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea853d1c-3062-4548-ab5b-6c3cef3cbb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.434804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea853d1c-3062-4548-ab5b-6c3cef3cbb11 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.435084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea853d1c-3062-4548-ab5b-6c3cef3cbb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.435359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea853d1c-3062-4548-ab5b-6c3cef3cbb11 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.436139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea853d1c-3062-4548-ab5b-6c3cef3cbb11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:10.436470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea853d1c-3062-4548-ab5b-6c3cef3cbb11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:10.437898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea853d1c-3062-4548-ab5b-6c3cef3cbb11 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:10.453293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 303/612] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:10.454321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864bb18-5dc1-40b6-89d9-88793f20d191 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.454612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864bb18-5dc1-40b6-89d9-88793f20d191 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.454892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864bb18-5dc1-40b6-89d9-88793f20d191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.472156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6864bb18-5dc1-40b6-89d9-88793f20d191 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:10.473644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6864bb18-5dc1-40b6-89d9-88793f20d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:10.529902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1e357-fc8f-4c67-8426-2ac0942e713f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.564372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 304/613] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:10.569170 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864bb18-5dc1-40b6-89d9-88793f20d191 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.584760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.585429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.585761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.586043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.586830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:10.587138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:10.590831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:10.613804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 310/614] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:10.614681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.643811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:10.700207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:10.714809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864bb18-5dc1-40b6-89d9-88793f20d191 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.749008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e1285-7f2e-49b2-b748-c138827f3711 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:10.752576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.753034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.753321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.753598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/d9ea56567eeb4392b5f9e5c84f16f413/roles/744abd0f005f43e8bc93a7267c81c7bd` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.770691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=d9ea56567eeb4392b5f9e5c84f16f413, role_id=744abd0f005f43e8bc93a7267c81c7bd)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:10.772296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:10.796212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 305/615] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:10 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/d9ea56567eeb4392b5f9e5c84f16f413/roles/744abd0f005f43e8bc93a7267c81c7bd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:10.796212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.816915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:10.817787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:10.818063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:10.818382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:10.842026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:10.853889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:10.855026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:10.855864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:10.857027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 311/616] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:10.869264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:10.941114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:10.958471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fa6d-5a0f-4e3f-b2f5-4222babd9317 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.006581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.008484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.009265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.009751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.020057 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.023007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:11.044099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:11.045303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:11.046480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:11.049860 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 306/617] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:11.057277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.062038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e55e8-4e32-4088-8df1-d9ef6d5c2487 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.102885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:11.117823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.119652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.120971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.121591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.122577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:11.123579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.125291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.140015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 312/618] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:11.147684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.205915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04428973-e2d6-4068-915c-2e01d7a9bcb2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.283143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064fb839-ebde-43f9-974f-fa9e364db811 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.293434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.294385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.294743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.295310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.296150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:11.296561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.298317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.322762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.324000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.324518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.324990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.337532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.339467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.340448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 307/619] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:11.348127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:11.363569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:11.364695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:11.365590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:11.365590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:11.365590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:11.365590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:11.367837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 313/620] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:11.373046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:11.374399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.421431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:11.482132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73120b0d-fd15-4f1b-b43e-a60f2f40573f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.518092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.519092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.519565 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.520014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.520953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:11.521435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.522978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.536441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 314/621] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:11.542025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.579264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b0c23-b962-4dc7-b3d6-d68af8eff181 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.654567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.655385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.655653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.655927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.660894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8cc43-cdae-45b2-938f-116aa233a345 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.662769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:11.680295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.681792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.699119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.700223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.700689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.701166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.708647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:11.709422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:11.710279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:11.711158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:11.711158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:11.711158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:11.711158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:11.712714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.720625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 308/622] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:11.729636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:11.734604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:11.735532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 21:00:11.736488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:11.742996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 315/623] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:11.755241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.873461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:11.880856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9403f-fea3-49e0-b971-d345e193aa7c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.924075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ece8a-1f04-4320-90fb-8be1d2573201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.924935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ece8a-1f04-4320-90fb-8be1d2573201 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.925343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ece8a-1f04-4320-90fb-8be1d2573201 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.925530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f418697-aa96-4d73-bbdc-f815e0ae1089 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:11.925810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ece8a-1f04-4320-90fb-8be1d2573201 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.926756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ece8a-1f04-4320-90fb-8be1d2573201 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:11.927246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ece8a-1f04-4320-90fb-8be1d2573201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.928922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ece8a-1f04-4320-90fb-8be1d2573201 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.952356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 316/624] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:11.954488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb122-b901-46df-88e6-14a62d90d2b7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.954779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb122-b901-46df-88e6-14a62d90d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.955063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fb122-b901-46df-88e6-14a62d90d2b7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.961140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 317/625] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:11.962085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fb122-b901-46df-88e6-14a62d90d2b7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:11.969489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af81d6-5193-4f43-a83e-06a43226b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:11.970336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af81d6-5193-4f43-a83e-06a43226b599 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.970720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af81d6-5193-4f43-a83e-06a43226b599 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.971098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af81d6-5193-4f43-a83e-06a43226b599 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:11.971931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af81d6-5193-4f43-a83e-06a43226b599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:11.972457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af81d6-5193-4f43-a83e-06a43226b599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:11.974285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af81d6-5193-4f43-a83e-06a43226b599 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:11.987458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 309/626] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:11.988098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:11.989771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27738be9-1e53-445c-9df4-f095a34c58c0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:11.990162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27738be9-1e53-445c-9df4-f095a34c58c0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:11.990540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27738be9-1e53-445c-9df4-f095a34c58c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.010150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-27738be9-1e53-445c-9df4-f095a34c58c0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:12.012160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-27738be9-1e53-445c-9df4-f095a34c58c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:12.080652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fb122-b901-46df-88e6-14a62d90d2b7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.104329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 310/627] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:12.106016 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27738be9-1e53-445c-9df4-f095a34c58c0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.138462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.139196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.139483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.139771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.171935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:12.223147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:12.224892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:12.225097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27738be9-1e53-445c-9df4-f095a34c58c0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.249267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:12.263651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.264498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.264785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.265063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.272310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:12.273766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:12.288592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:12.290763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 311/628] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:12.297281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.337637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 318/629] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:12.338491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.396142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d6203-4e9e-437f-bc0f-58431b382949 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.429077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:12.432291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.434104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.434388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.434669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.442598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddba673-6072-42a3-b6b5-616eb32ae051 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.446687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:12.455632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:12.457890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 312/630] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:12.459832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.469851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:12.486642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.487562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.487675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.487906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.488788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:12.489168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:12.490530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:12.503759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 319/631] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:12.504761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.577735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee14eb7d-f3bd-4924-aa13-b680aaaeb5d1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.618032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.618835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.619122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.619401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.621093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6b1cb-09e3-47fb-b3c8-ab60d2b3f415 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.630812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:12.632292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:12.649632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:12.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:12.651365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:12.651365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:12.651365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:12.651365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:12.651365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 313/632] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:12.651687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.658317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df499df-acd7-4804-8bef-aae5eaf5d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.658992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df499df-acd7-4804-8bef-aae5eaf5d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.659279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df499df-acd7-4804-8bef-aae5eaf5d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.659561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df499df-acd7-4804-8bef-aae5eaf5d6a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.660346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df499df-acd7-4804-8bef-aae5eaf5d6a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:12.660659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df499df-acd7-4804-8bef-aae5eaf5d6a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:12.662026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df499df-acd7-4804-8bef-aae5eaf5d6a8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:12.671197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 320/633] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:12.672621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828b20-2a2b-4bbd-9fcf-5e5922939d52 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.672913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828b20-2a2b-4bbd-9fcf-5e5922939d52 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.673195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828b20-2a2b-4bbd-9fcf-5e5922939d52 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.676121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 321/634] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:12.676121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828b20-2a2b-4bbd-9fcf-5e5922939d52 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.682442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:12.723792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:12.771928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f9291-c05b-4532-9109-1aa68c32fe69 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.788650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828b20-2a2b-4bbd-9fcf-5e5922939d52 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:12.815796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84c682-2a73-4793-b0a7-f191cb3073d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.816875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c682-2a73-4793-b0a7-f191cb3073d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.817263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c682-2a73-4793-b0a7-f191cb3073d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.817659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84c682-2a73-4793-b0a7-f191cb3073d4 None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/759ce183ee164679ba3d16860c088804/roles/744abd0f005f43e8bc93a7267c81c7bd` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.829925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:12.830799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.830924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.831141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.831867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:12.832197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:12.833646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:12.834109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84c682-2a73-4793-b0a7-f191cb3073d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=759ce183ee164679ba3d16860c088804, role_id=744abd0f005f43e8bc93a7267c81c7bd)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:12.835550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84c682-2a73-4793-b0a7-f191cb3073d4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:12.852043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 322/635] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:12.852043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:12.856299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 314/636] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:12 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/759ce183ee164679ba3d16860c088804/roles/744abd0f005f43e8bc93a7267c81c7bd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:12.857958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b99a9-a5cc-42e0-8592-2e7bff7a36d3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:12.858464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b99a9-a5cc-42e0-8592-2e7bff7a36d3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:12.858802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b99a9-a5cc-42e0-8592-2e7bff7a36d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:12.878873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d66b99a9-a5cc-42e0-8592-2e7bff7a36d3 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:12.880236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d66b99a9-a5cc-42e0-8592-2e7bff7a36d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:12.957140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:12.967074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 315/637] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:12.967074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b99a9-a5cc-42e0-8592-2e7bff7a36d3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.015520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404dbd8-e2a4-428d-9529-f04bd5584d85 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.018565 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:13.062953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.063774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.064060 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.064383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.076452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.077908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.094571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b99a9-a5cc-42e0-8592-2e7bff7a36d3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:13.097635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:13.098787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:13.099652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:13.099652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:13.099652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:13.099652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:13.099652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 323/638] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:13.104302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.132822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.133634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.133912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.134249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.142367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.143931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:13.159567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:13.160542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 316/639] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:13.162045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.218718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcceb8-b0b9-491b-93b4-c6e2753ee3ef None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.240014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:13.259009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.259825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.260108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.260412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.272049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:13.281532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:13.282636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:13.283502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:13.288190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 324/640] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:13.289357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.299277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e78475-22a0-47c6-8187-1b0093e967c3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.310640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:13.347261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.347945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.348548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.348920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.349640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:13.349955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.351485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.364531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 317/641] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:13.365360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.418127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44153e-9d16-4d02-90d4-9be1693c8ba5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.453722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5dab9-2574-4376-b4af-d10eba37fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.454388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5dab9-2574-4376-b4af-d10eba37fb9c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.454667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5dab9-2574-4376-b4af-d10eba37fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.454936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5dab9-2574-4376-b4af-d10eba37fb9c None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.455794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5dab9-2574-4376-b4af-d10eba37fb9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:13.456109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5dab9-2574-4376-b4af-d10eba37fb9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.457568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5dab9-2574-4376-b4af-d10eba37fb9c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.469655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 325/642] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:13.470848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259b955-acc0-4c48-9408-ec046afaf10e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.471135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259b955-acc0-4c48-9408-ec046afaf10e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.471410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259b955-acc0-4c48-9408-ec046afaf10e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.472816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 326/643] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:13.477310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259b955-acc0-4c48-9408-ec046afaf10e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.481350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444905e-2834-42d6-b67b-2a231c536a95 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.503187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:13.518619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.519296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.519585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.519906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.520684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:13.520995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.522367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.531103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 318/644] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:13.536330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.562009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:13.590519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259b955-acc0-4c48-9408-ec046afaf10e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.626764 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3688c-9183-47bd-93b9-29cb20056999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.627823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3688c-9183-47bd-93b9-29cb20056999 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.628101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3688c-9183-47bd-93b9-29cb20056999 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.628407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3688c-9183-47bd-93b9-29cb20056999 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.635747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3688c-9183-47bd-93b9-29cb20056999 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.637837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3688c-9183-47bd-93b9-29cb20056999 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-9ec3688c-9183-47bd-93b9-29cb20056999 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:13.652534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:13.653497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:13.654610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:13.655665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b1a5d-9592-43c9-836a-bf456792ac20 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.658327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 327/645] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:13.659443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761939-ef7b-4173-9373-8e687201d4aa None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.659757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761939-ef7b-4173-9373-8e687201d4aa None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.660001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8761939-ef7b-4173-9373-8e687201d4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.677852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f8761939-ef7b-4173-9373-8e687201d4aa None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:13.679022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f8761939-ef7b-4173-9373-8e687201d4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:13.692409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.693076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.693365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.693646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.694473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=4fd5a266491c487385349368b5ccbbc1) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:13.694788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.696270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.712237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 319/646] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/role_assignments?user.id=4fd5a266491c487385349368b5ccbbc1&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:13.712237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.765953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:13.768589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 328/647] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:13.769617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8761939-ef7b-4173-9373-8e687201d4aa None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.843673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669fdb0-eb00-4a83-b7a9-a3dbd20886a8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.852538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:13.882861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.884701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.884701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.884701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.892372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8761939-ef7b-4173-9373-8e687201d4aa None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:13.896800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.899118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:13.919527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:13.920687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:13.921629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:13.921629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:13.921629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:13.921629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:13.925499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 320/648] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:13.926374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:13.937036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:13.937989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:13.938809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:13.939276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:13.940840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:13.941440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:13.943235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:13.965604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 329/649] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:13.966431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.045942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:14.049106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6f345-8a6d-4c0e-ad2e-906a4f7a1929 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.092570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.093643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.093924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.094353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.098561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58436f78-0f4a-48f2-8529-60b4131fe7e2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.107856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:14.118172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:14.119111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:14.119950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 321/650] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:14.121360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.131723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:14.147533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.148239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.148824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.149110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.150252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:14.150566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.152312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:14.170587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 330/651] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:14.171453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.256623 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66418e2-ad61-46a6-a8c3-1209f0395a02 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.291727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.293133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.293530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.293894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.317340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5007cf-8a29-4f3c-bfad-19669546125f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.323307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:14.356543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.357258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.357643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.357922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.358716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:14.359025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.360413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:14.369769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 331/652] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:14.370806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.377129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.379893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:14.424261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:14.502514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc2eac-8562-4755-8d45-8f9ad57c8f71 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.507533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 322/653] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:14.508449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.541939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.544573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.544859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.545135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.559769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.562333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:14.571081 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:14.585040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:14.586005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:14.587020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:14.594871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 332/654] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:14.595698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.630761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10bc19f-3eef-41fb-8156-d1644d4a56b7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.679646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.681734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.682164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.682593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.697769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.700289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:14.713527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf64ee-871e-45f2-9521-46a196283a50 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.716736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:14.721186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:14.722329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:14.723718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:14.723718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:14.723718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:14.723718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:14.729819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 323/655] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:14.731413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.765278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.766550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.766978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.767420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.782119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.784495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:14.809498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:14.810444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:14.811329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:14.811329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:14.811329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:14.811329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:14.811329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 333/656] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:14.811610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.857677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a554ad4-64ae-4aee-9de8-aa25943504f0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.873012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:14.905528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.906915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.907344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.907899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.909021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:14.909742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.912052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:14.938382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 324/657] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:14.938382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:14.938650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e4f8e-290b-43ce-ac1b-8bd0304af003 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:14.981683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:14.982976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:14.983437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:14.984161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:14.985356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:14.985871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:14.987960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.008241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 334/658] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:15.008241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.034265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.065618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cc460-ffec-4d7f-8256-4f6ae6de47c7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.103364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.104036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.104386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.105175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.106050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:15.106873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.108361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.128962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 325/659] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:15.129811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.141883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907b21b-2598-42df-87fb-7c4a5d73890a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.159496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.179448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.180349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.180811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.181230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.235959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236759cb-ece6-41fa-9a80-e9550244f38e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.255316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.256794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.271469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ca1b0-038a-4c66-bbf7-5287a0a47746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.272303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca1b0-038a-4c66-bbf7-5287a0a47746 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.272585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca1b0-038a-4c66-bbf7-5287a0a47746 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.272859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ca1b0-038a-4c66-bbf7-5287a0a47746 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.275036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.282872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ca1b0-038a-4c66-bbf7-5287a0a47746 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.284345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ca1b0-038a-4c66-bbf7-5287a0a47746 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6e8ca1b0-038a-4c66-bbf7-5287a0a47746 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:15.299340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:15.300335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:15.301269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 326/660] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:15.301886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d2636-6bda-471f-ba5c-9686f48b81e4 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.302461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d2636-6bda-471f-ba5c-9686f48b81e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.302461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d2636-6bda-471f-ba5c-9686f48b81e4 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.303662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 327/661] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:15.309238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d2636-6bda-471f-ba5c-9686f48b81e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.371676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 335/662] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:15.371676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.407026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.421646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d2636-6bda-471f-ba5c-9686f48b81e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.458584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73abd3a3-50a6-4e48-bf3f-02b63183cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.459383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd3a3-50a6-4e48-bf3f-02b63183cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.459670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd3a3-50a6-4e48-bf3f-02b63183cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.459946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73abd3a3-50a6-4e48-bf3f-02b63183cfd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.467614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abd3a3-50a6-4e48-bf3f-02b63183cfd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.469100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73abd3a3-50a6-4e48-bf3f-02b63183cfd4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.474465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa16622-684a-4fb9-9028-1e6a90014ae3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-73abd3a3-50a6-4e48-bf3f-02b63183cfd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:15.486857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:15.487811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:15.488716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 328/663] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:15.489759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4823-a2c8-4ace-b08b-7d8cc715d005 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.489759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4823-a2c8-4ace-b08b-7d8cc715d005 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.489914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c4823-a2c8-4ace-b08b-7d8cc715d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.496843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.507001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aa7c4823-a2c8-4ace-b08b-7d8cc715d005 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:15.508214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa7c4823-a2c8-4ace-b08b-7d8cc715d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:15.515724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.516438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.516725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.517000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.517834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:15.518147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.519568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.542110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 336/664] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:15.542110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.584363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 329/665] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:15.585074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4823-a2c8-4ace-b08b-7d8cc715d005 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.664528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36d4ed-64a2-4213-b679-08e2e41691ae None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.673130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.696663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c4823-a2c8-4ace-b08b-7d8cc715d005 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.701813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.702611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.702890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.703162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.713704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.716205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.734777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.735434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.735710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.735986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:15.736085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:15.737046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:15.737944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:15.737944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:15.737944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:15.737944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:15.738173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:15.738173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.738693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.740304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 337/666] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:15.741419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.751200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 330/667] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:15.752019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.773016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.850582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d761c80-0e4e-47dd-80c6-81603b520016 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.866255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c332a-a3e8-4db8-a941-311e83a9576f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:15.887194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.887669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.887946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.888240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.903912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:15.904923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:15.905204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:15.905478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:15.913082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:15.918985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:15.926769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:15.927714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:15.928952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:15.932729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 331/668] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:15.934656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:15.966344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:15.967794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:15.997888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.042064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70196c4d-7c11-4b30-9bf6-495e61ef4e3e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.079716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.080404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.080682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.080955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.081674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:16.081977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.083339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.084244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 338/669] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:16.086020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.094848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 332/670] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:16.095659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.150652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.190563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026a4d-44ce-46e6-a169-838205e1ab1a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.192279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7605e-79e8-4d7c-b307-14a9266b5cc3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.216030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.225307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.225453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad7b0e-dff1-4db8-82d5-afbe24ce6010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.225967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.226062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7b0e-dff1-4db8-82d5-afbe24ce6010 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.226245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.226339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7b0e-dff1-4db8-82d5-afbe24ce6010 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.226515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.226609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7b0e-dff1-4db8-82d5-afbe24ce6010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.227280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:16.227378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad7b0e-dff1-4db8-82d5-afbe24ce6010 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=c1e4d798757a41cfad3454940c12bcab) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:16.227585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.227672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad7b0e-dff1-4db8-82d5-afbe24ce6010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.228973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.229110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad7b0e-dff1-4db8-82d5-afbe24ce6010 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.235140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 339/671] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/role_assignments?user.id=c1e4d798757a41cfad3454940c12bcab&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:16.236457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5fab-9366-4e30-b8db-36bd41067eef None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.236750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5fab-9366-4e30-b8db-36bd41067eef None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.241248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676f5fab-9366-4e30-b8db-36bd41067eef None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.241426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 333/672] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:16.241426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.242911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 340/673] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:16.243898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5fab-9366-4e30-b8db-36bd41067eef None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.361923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676f5fab-9366-4e30-b8db-36bd41067eef None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.362275 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ff523-165d-4969-b0f5-e3a36180b3bc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.384524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.403267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50533e5-114e-466a-9b84-254e3443f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.404011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.404218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50533e5-114e-466a-9b84-254e3443f131 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.404432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50533e5-114e-466a-9b84-254e3443f131 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.405149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50533e5-114e-466a-9b84-254e3443f131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.405253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.405253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.405381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.413284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50533e5-114e-466a-9b84-254e3443f131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.414737 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50533e5-114e-466a-9b84-254e3443f131 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.419838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.421359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d50533e5-114e-466a-9b84-254e3443f131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:16.431607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:16.432696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:16.433755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 341/674] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:16.434561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5b15-1660-4db5-8886-7107581dc33e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.434831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5b15-1660-4db5-8886-7107581dc33e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.435107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c5b15-1660-4db5-8886-7107581dc33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:16.440679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:16.441612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:16.442511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:16.442511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:16.442511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:16.442511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:16.442511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 334/675] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:16.443238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.456521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-827c5b15-1660-4db5-8886-7107581dc33e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:16.457730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-827c5b15-1660-4db5-8886-7107581dc33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:16.515457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.538890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 342/676] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:16.539747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c5b15-1660-4db5-8886-7107581dc33e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.559959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad81d83d-32ef-42bc-90c4-2e6614660810 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.599249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.600437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.600950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.601434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.614621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.616241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:16.635630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:16.636884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:16.637820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:16.637820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:16.637820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:16.637820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:16.637820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 335/677] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:16.638888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.664129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c5b15-1660-4db5-8886-7107581dc33e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.666377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.703004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.703595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.703869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.704141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.704973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:16.705281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.706706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.719930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 343/678] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:16.720808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.758918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13c19a-1e05-4bc7-a221-4e327d411ed7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.766279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.795967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.796660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.796946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.797219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.798644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:16.798644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.799632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.816795 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 336/679] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:16.816795 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.837009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52db153-e826-4d6a-ba0e-d96e407d822b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.873414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.874215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.874502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.874779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.885392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.887462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:16.904609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:16.905532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:16.906411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:16.906411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:16.906411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:16.906411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:16.906411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 344/680] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:16.906704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:16.907562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:16.929108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004282d5-b9a2-466f-8052-56f9e98983d7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:16.968910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:16.969498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:16.969780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:16.970054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:16.970803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:16.971109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:16.972563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:16.984527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 337/681] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:16.989083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.008079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:17.017860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710048a-2a01-4dcb-8d27-287a6e584ae0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.058412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.059536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.060095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.060419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.061263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=35b6a283856448d9aca6f50a3d58742f) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:17.061583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.063933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.070537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 345/682] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/role_assignments?user.id=35b6a283856448d9aca6f50a3d58742f&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:17.071351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.114763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc7db0-7e25-4c9c-b381-a21992a8a19d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.153094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.153917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.154201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.154479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.162105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.163589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:17.179820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:17.180926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:17.181850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 338/683] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:17.182937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.187108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:17.211050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947127a-6111-474e-bf94-94c847c611c4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.263282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.263282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.263660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.265300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.266895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:17.266895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.268159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.283635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 346/684] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:17.285121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.306104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:17.332338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01186f2-042a-4f96-b4d7-985c0487453b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.382907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.384485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.384976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.385690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.396572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.398542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.409690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9a20-5d32-4aa7-b467-4cbcc45ce7c7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:17.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:17.419706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:17.420757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 339/685] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:17.421361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.462533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.463479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.463910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.464890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.465830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:17.466314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.468617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.491518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 347/686] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:17.492448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.497893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:17.548625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4862a2d-72fb-4bc9-a88a-be7c38cb6a21 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.590273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.591047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.591325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.591595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.592671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:17.593110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.595195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.622254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b081c76-41a5-4642-8ea2-7a6de6c18eb2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.623366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 340/687] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 21:00:17 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:17.624550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.662321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.663221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.663632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.664053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.665085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:17.665502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.667570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.692916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 348/688] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 16 21:00:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:17.703143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:17.756082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d206f3a-abbb-4e73-a6a8-f4ff7b2fcfb5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.780391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:17.805095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.805708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.805991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.806269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.807127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=d9ea56567eeb4392b5f9e5c84f16f413) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:17.807443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.809478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:17.823247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 341/689] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:17 2022] GET /identity/v3/role_assignments?user.id=d9ea56567eeb4392b5f9e5c84f16f413&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:17.864114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a596-4ae9-44fb-b226-03d9c3d97e6c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:17.912609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:17.913743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:17.914243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:17.914735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:17.923160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:17.998309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:17.999876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:18.113433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 349/690] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:18.119228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:18.238818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d4f03-c015-4e6b-bf23-11b51be0343f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:18.274055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:18.274861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:18.275147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:18.275424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:18.286849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:18.288390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:18.307064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:18.308686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:18.309579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:18.309579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:18.309579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:18.309579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:18.313439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 342/691] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:18.314809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:18.350570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:18.455848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109e23-2e25-40b1-9d98-6153ae9bbaf9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:18.507669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4cb5a-8cd8-4759-9ee7-75bb5132a595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:18.508386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cb5a-8cd8-4759-9ee7-75bb5132a595 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:18.508672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cb5a-8cd8-4759-9ee7-75bb5132a595 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:18.508948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4cb5a-8cd8-4759-9ee7-75bb5132a595 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:18.509691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4cb5a-8cd8-4759-9ee7-75bb5132a595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:18.510000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4cb5a-8cd8-4759-9ee7-75bb5132a595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:18.511731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4cb5a-8cd8-4759-9ee7-75bb5132a595 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:18.531328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 350/692] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:18.537194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:18.589230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3634f4-84aa-4ed3-9c8c-035e2ce67d57 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:18.589651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3634f4-84aa-4ed3-9c8c-035e2ce67d57 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:18.590159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3634f4-84aa-4ed3-9c8c-035e2ce67d57 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:18.592122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:18.597899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 351/693] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:18 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:18.612854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4c1d-0217-4f9d-ae1e-c705c4886762 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:18.612854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4c1d-0217-4f9d-ae1e-c705c4886762 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:18.612854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4c1d-0217-4f9d-ae1e-c705c4886762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:18.640854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-676c4c1d-0217-4f9d-ae1e-c705c4886762 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:18.642052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-676c4c1d-0217-4f9d-ae1e-c705c4886762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:18.711162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539af93b-b818-4f07-8da9-760d0db40a03 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:18.767765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 352/694] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 21:00:18.783529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:18.784373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:18.784658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:18.784936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:18.794434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:18.795920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:18.815236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:18.816201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:18.817565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 343/695] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:18.824509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4c1d-0217-4f9d-ae1e-c705c4886762 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:18.840695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:18.872558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:18.984642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:18.993233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df26db-827a-4320-937f-e03ae964f822 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:19.034386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:19.035565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.036049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.036554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.038919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4c1d-0217-4f9d-ae1e-c705c4886762 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:19.049599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:19.059947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:19.060917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:19.061753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:19.064819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 344/696] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:19.069985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:19.113065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:19.114186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.114813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.115420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.116468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:19.116983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:19.118758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:19.144734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 353/697] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:19.150201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:19.188042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58d94-5750-4704-be85-a54c7a0c0ffd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:19.261506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:19.261791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.261942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.262212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.262928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:19.263232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:19.264655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:19.270670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:19.283829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 345/698] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:19.291024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e6de-f50d-4db2-b5ff-6e906df49d97 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:19.293439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:19.332481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:19.334595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.335084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.336346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.337412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=759ce183ee164679ba3d16860c088804) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:19.338109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:19.341478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:19.342676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:19.357834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 354/699] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:19 2022] GET /identity/v3/role_assignments?user.id=759ce183ee164679ba3d16860c088804&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:19.459452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b01fb-7468-47c4-a685-3ff89b25bb64 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:19.510362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:19.511927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.512464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.512942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.525050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:19.527212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:19.547179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:19.548195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:19.549124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:19.549124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:19.549124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:19.549124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:19.551455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 346/700] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:19.556786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:19.687134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fc165-58a4-430f-8826-baab2e9c1ba3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:19.723220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c46715-3ff0-4923-9d68-dc8669ca605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:19.724147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c46715-3ff0-4923-9d68-dc8669ca605d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.724465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c46715-3ff0-4923-9d68-dc8669ca605d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.724744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c46715-3ff0-4923-9d68-dc8669ca605d None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.725472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c46715-3ff0-4923-9d68-dc8669ca605d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:19.725783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c46715-3ff0-4923-9d68-dc8669ca605d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:19.727161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c46715-3ff0-4923-9d68-dc8669ca605d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:19.739784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 355/701] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:19.745197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:19.822231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:19.863734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989fe2d-5da3-4883-9666-ad1f9d66a372 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:19.896732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cac08-0be3-4fc5-adc4-50c51ede7d11 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.897085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cac08-0be3-4fc5-adc4-50c51ede7d11 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.897283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cac08-0be3-4fc5-adc4-50c51ede7d11 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.899177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 356/702] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:19.902355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779a839-8c86-4983-a476-702324554de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:19.903725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a839-8c86-4983-a476-702324554de1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.904248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a839-8c86-4983-a476-702324554de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.904743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779a839-8c86-4983-a476-702324554de1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.904995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2ef73-9ecd-44c1-a31c-6f9542f088f5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:19.905286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2ef73-9ecd-44c1-a31c-6f9542f088f5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:19.905566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2ef73-9ecd-44c1-a31c-6f9542f088f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:19.914299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779a839-8c86-4983-a476-702324554de1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:19.916063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779a839-8c86-4983-a476-702324554de1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:19.924309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ceb2ef73-9ecd-44c1-a31c-6f9542f088f5 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:19.925553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ceb2ef73-9ecd-44c1-a31c-6f9542f088f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:19.927657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a779a839-8c86-4983-a476-702324554de1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:19.934729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:19.936076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:19.937138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:19.940697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 347/703] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:00:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:19.949245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779a839-8c86-4983-a476-702324554de1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.012830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 357/704] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:20.035753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2ef73-9ecd-44c1-a31c-6f9542f088f5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.081185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779a839-8c86-4983-a476-702324554de1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:20.122366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:20.131658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:20.132608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.133070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.133520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.135062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:20.135581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:20.138270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:20.163486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 348/705] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:00:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:20.168277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2ef73-9ecd-44c1-a31c-6f9542f088f5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:20.170780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.205420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:20.206690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.207182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.207663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.208686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:20.210326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:20.225998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:20.227020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:20.227878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:20.232218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 358/706] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jun 16 21:00:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:20.239664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.251234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:20.343328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f627-da12-4942-b6a0-07832869a029 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:20.396314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a215c6-dc74-48d1-b550-74282753366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:20.396969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a215c6-dc74-48d1-b550-74282753366c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.397246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a215c6-dc74-48d1-b550-74282753366c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.397519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a215c6-dc74-48d1-b550-74282753366c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.432581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff04cf8-bef0-41f1-9254-0dc7af67fd8d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:20.458008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:20.472701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a215c6-dc74-48d1-b550-74282753366c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:20.474467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a215c6-dc74-48d1-b550-74282753366c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:20.492864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4237fea3-957b-4b2a-8f25-32502b8b2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:20.494543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fea3-957b-4b2a-8f25-32502b8b2907 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.495035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fea3-957b-4b2a-8f25-32502b8b2907 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.496125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4237fea3-957b-4b2a-8f25-32502b8b2907 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.497070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237fea3-957b-4b2a-8f25-32502b8b2907 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:20.498127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237fea3-957b-4b2a-8f25-32502b8b2907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:20.500016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4237fea3-957b-4b2a-8f25-32502b8b2907 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:20.509409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 359/707] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 16 21:00:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:20.512783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50ada6-7d5c-4bfa-90b1-e3e5f24fb708 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.514175 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50ada6-7d5c-4bfa-90b1-e3e5f24fb708 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.514672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50ada6-7d5c-4bfa-90b1-e3e5f24fb708 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.516511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 360/708] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:20.517534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50ada6-7d5c-4bfa-90b1-e3e5f24fb708 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.590491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 349/709] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 21:00:20.591915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782fbc-210f-4d57-b462-6755426591fc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.592205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782fbc-210f-4d57-b462-6755426591fc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.592507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb782fbc-210f-4d57-b462-6755426591fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.607191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:20.613684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cb782fbc-210f-4d57-b462-6755426591fc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:20.614802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cb782fbc-210f-4d57-b462-6755426591fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:20.670479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50ada6-7d5c-4bfa-90b1-e3e5f24fb708 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:20.695979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 350/710] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:20.697335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb782fbc-210f-4d57-b462-6755426591fc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.720558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:20.733898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:20.734576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.734847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.735117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.735826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:20.736231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:20.737529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:20.743720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 361/711] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 16 21:00:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:20.744656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.844768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb782fbc-210f-4d57-b462-6755426591fc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:20.880588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b9db4-33d4-405f-ab70-fc563e43b8b5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:20.886482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dd23e-d664-43a5-b3a5-2b36ac908f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:20.887306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dd23e-d664-43a5-b3a5-2b36ac908f99 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.887584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dd23e-d664-43a5-b3a5-2b36ac908f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.887852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dd23e-d664-43a5-b3a5-2b36ac908f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.899424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dd23e-d664-43a5-b3a5-2b36ac908f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:20.900914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dd23e-d664-43a5-b3a5-2b36ac908f99 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:20.919545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-465dd23e-d664-43a5-b3a5-2b36ac908f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:20.923688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:20.924632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:20.925556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:20.925556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:20.925556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:20.925556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:20.928265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 351/712] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:20.929616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce7183-bf86-4e25-9f17-904379b45a65 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.929893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce7183-bf86-4e25-9f17-904379b45a65 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.930165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce7183-bf86-4e25-9f17-904379b45a65 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.931710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 352/713] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:20.932445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce7183-bf86-4e25-9f17-904379b45a65 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:20.933281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66808fdc-734c-431f-9685-c0da790ea7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:20.934187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808fdc-734c-431f-9685-c0da790ea7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.934474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808fdc-734c-431f-9685-c0da790ea7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.934753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808fdc-734c-431f-9685-c0da790ea7b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.937153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66808fdc-734c-431f-9685-c0da790ea7b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:20.938554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66808fdc-734c-431f-9685-c0da790ea7b5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-66808fdc-734c-431f-9685-c0da790ea7b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:20.953914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:20.954940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:20.955828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:20.958774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 362/714] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:20 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:20.960265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c40f9-ac54-4459-a864-b78231cc18ef None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:20.960793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c40f9-ac54-4459-a864-b78231cc18ef None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:20.961270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c40f9-ac54-4459-a864-b78231cc18ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:20.980464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ae8c40f9-ac54-4459-a864-b78231cc18ef None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:20.982182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ae8c40f9-ac54-4459-a864-b78231cc18ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:21.026845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:21.059054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 363/715] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:21.060353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c40f9-ac54-4459-a864-b78231cc18ef None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.077682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce7183-bf86-4e25-9f17-904379b45a65 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.120084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.120913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.121201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.121482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.122500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:21.122815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.124531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.141531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 353/716] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:21.142383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.188449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c40f9-ac54-4459-a864-b78231cc18ef None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.217875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:21.231498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.232534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.233022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.233555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.234573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] RBAC: Adding query filter params (name=network) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:21.235105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.236763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.242423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 364/717] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:21.243488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.251618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cfc0ac-3a28-4783-ac38-75691dc43f55 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.281440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:21.288347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.289162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.289450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.289839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.302195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:21.311277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:21.312253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:21.313116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:21.317498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 354/718] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:21.318447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.360852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218a8db-c766-4a6b-8b6b-4d968f20c85f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.398070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.399237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.399701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.400189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.408633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.410299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.423885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bdc0d-1d9c-4051-9f0d-31918d471934 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:21.426072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:21.426958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:21.427835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:21.430069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 365/719] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:21.431065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.460955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.461772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.462158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.462535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.463344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] RBAC: Adding query filter params (type=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:21.463751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.466041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.472444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 355/720] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:21.472873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.496622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:21.535376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:21.552065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01cebe-9f15-414f-a241-360df0f01b48 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.586010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f5a72-0bbf-468d-8d3f-5fb01c9e85cb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.591817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.592852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.593340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.593843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.594810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:21.595375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.597060 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.608256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 366/721] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:21.614820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.643491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.644674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.645163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.645669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.646779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:21.647394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.649150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.664634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 356/722] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:21.677485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.724240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946fad8-3d36-4a98-8f46-820614239152 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.750785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:21.774289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.775102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.776241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.776779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.795854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.797872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:21.821568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:21.822521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:21.823947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:21.823947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:21.823947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:21.823947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:21.826012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 367/723] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:21.832297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:21.855237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69765dfd-d55d-4a4c-908e-ef2f2e682b8c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.877549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:21.913667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.914302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.914539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.914827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.915660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=c1e4d798757a41cfad3454940c12bcab) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:21.915976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:21.917810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:21.928750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 357/724] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/role_assignments?user.id=c1e4d798757a41cfad3454940c12bcab&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:21.958176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39fbd2-d362-4f33-af7b-ef50cc19ec73 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:21.996950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:21.998052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:21.998541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:21.999034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:21.999993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:22.000536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:22.002182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:22.020471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 368/725] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:22.022233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:22.165979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3e4ec-4956-453b-a0df-4de1154ed47f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:22.233077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5a4c6-1922-4cdf-800f-f12feb7fa3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:22.233908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5a4c6-1922-4cdf-800f-f12feb7fa3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:22.234190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5a4c6-1922-4cdf-800f-f12feb7fa3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:22.234467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5a4c6-1922-4cdf-800f-f12feb7fa3b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:22.242523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5a4c6-1922-4cdf-800f-f12feb7fa3b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:22.243984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5a4c6-1922-4cdf-800f-f12feb7fa3b1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-87c5a4c6-1922-4cdf-800f-f12feb7fa3b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:22.259530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:22.260518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:22.261531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 358/726] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:00:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:22.268194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:22.307487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:22.405283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d7f80-68e9-4c72-9791-6752bfd03731 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:22.422779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09983-2fdb-472a-8b55-a381cffa9f37 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:22.423063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09983-2fdb-472a-8b55-a381cffa9f37 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:22.423246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d09983-2fdb-472a-8b55-a381cffa9f37 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:22.425050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 359/727] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:22.429862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61199d2-811b-46c6-9e0d-8836808049e1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:22.430145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61199d2-811b-46c6-9e0d-8836808049e1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:22.430418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61199d2-811b-46c6-9e0d-8836808049e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:22.444701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:22.445377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:22.445664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:22.445938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:22.446771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:22.447079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:22.449094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:22.470568 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e61199d2-811b-46c6-9e0d-8836808049e1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:22.471797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e61199d2-811b-46c6-9e0d-8836808049e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:22.486280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 369/728] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 16 21:00:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:22.492357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:22.520490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:22.588609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 360/729] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 21:00:22.590257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:22.611917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec777a1-907a-4bbf-ade1-57fd38517c65 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:22.622990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61199d2-811b-46c6-9e0d-8836808049e1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:22.657231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:22.657892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:22.658177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:22.658452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:22.782796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:22.784165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:22.796282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61199d2-811b-46c6-9e0d-8836808049e1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:22.862743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:22.863542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:22.863822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:22.864093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:22.875701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:22.884521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:22.885523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:22.887653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 361/730] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:22.893095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:22.932526 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:22.958261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:22.993299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 370/731] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 21:00:22.999109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.086668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70ee71-55d3-4d24-9821-29243e250636 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.116768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfeb85-24f3-42e4-9250-2064830b6906 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.162841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79e212-c475-48c4-8e5b-b78101b4ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.163678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e212-c475-48c4-8e5b-b78101b4ee62 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.163948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e212-c475-48c4-8e5b-b78101b4ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.164250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79e212-c475-48c4-8e5b-b78101b4ee62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.182107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.183421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.183821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.184101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.184895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:23.185203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.186606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.190288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79e212-c475-48c4-8e5b-b78101b4ee62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.191744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79e212-c475-48c4-8e5b-b78101b4ee62 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.207405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 362/732] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:23.212723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-3c79e212-c475-48c4-8e5b-b78101b4ee62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:23.231881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:23.232851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:23.234610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:23.234610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:23.234610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:23.234610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:23.234610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 371/733] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:23.235225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48afbb-845c-4917-99d7-c211a47db13d None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.238581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48afbb-845c-4917-99d7-c211a47db13d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.238891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48afbb-845c-4917-99d7-c211a47db13d None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.240474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 372/734] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:23.241199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48afbb-845c-4917-99d7-c211a47db13d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.276281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:23.340053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:23.354935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b03f6-1b84-4bcb-a296-9606a14eca82 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.359860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48afbb-845c-4917-99d7-c211a47db13d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.397840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.398047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802acf4b-9ad0-40a0-a10e-514ce11bf765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.398511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802acf4b-9ad0-40a0-a10e-514ce11bf765 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.398792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802acf4b-9ad0-40a0-a10e-514ce11bf765 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.399128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802acf4b-9ad0-40a0-a10e-514ce11bf765 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.399521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.399852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802acf4b-9ad0-40a0-a10e-514ce11bf765 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:23.400109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.400256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802acf4b-9ad0-40a0-a10e-514ce11bf765 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.400656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.401668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802acf4b-9ad0-40a0-a10e-514ce11bf765 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.419264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.419449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 373/735] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:23.419449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53556430-c77f-4cdc-8840-0639ecf6c1f7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.419449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53556430-c77f-4cdc-8840-0639ecf6c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.419449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53556430-c77f-4cdc-8840-0639ecf6c1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.421354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.436557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-53556430-c77f-4cdc-8840-0639ecf6c1f7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:23.437785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-53556430-c77f-4cdc-8840-0639ecf6c1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:23.446985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:23.447841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:23.448832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:23.448832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:23.448832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:23.448832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:23.455269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 363/736] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:23.455269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.522948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 374/737] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 21:00:23.524833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53556430-c77f-4cdc-8840-0639ecf6c1f7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.566236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:23.588277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967a79e-3c3f-4e10-9a47-f381bea51488 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.631047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.632218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.632806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.633299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.641261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.643185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:23.659324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:23.660251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:23.661150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:23.664581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 364/738] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:23.665452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.666262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53556430-c77f-4cdc-8840-0639ecf6c1f7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.669677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:23.716002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.717468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.718221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.718690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.719850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:23.720373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.722662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.740497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 375/739] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:23.741686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.784612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3912a8da-98c0-44bf-92fa-2122c26959b5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.821301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.822065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.822420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.822767 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.824133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.825652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.851881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 365/740] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:23 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:23.851881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:23.877422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:23.902820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7629b3-5278-4087-96f2-158d87ad1905 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:23.959306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:23.964208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:23.964208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:23.964208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:23.964208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:23.964208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:23.964208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:23.978808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 376/741] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:23.981312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:23.986397 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:24.056259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a526061-4268-4e44-ace1-bf120d1401c5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:24.101331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:24.102726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.103234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.103710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.121467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:24.123830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c980ebc-3b39-4ff1-bebb-f9c8deaa6046 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:24.127840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:24.161234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:24.162257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:24.163175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 366/742] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:24.170029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:24.195205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567e3db-64be-429c-875e-3e13b5c84aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:24.196270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e3db-64be-429c-875e-3e13b5c84aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.196758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e3db-64be-429c-875e-3e13b5c84aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.197234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e3db-64be-429c-875e-3e13b5c84aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.198287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567e3db-64be-429c-875e-3e13b5c84aa6 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=804e3317fa4f460aa7078b94db562934) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:24.199500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567e3db-64be-429c-875e-3e13b5c84aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:24.201208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567e3db-64be-429c-875e-3e13b5c84aa6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:24.207831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 377/743] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:23 2022] GET /identity/v3/role_assignments?user.id=804e3317fa4f460aa7078b94db562934&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:24.209419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778799-3399-4255-a69b-70cd194e7ef3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.209932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778799-3399-4255-a69b-70cd194e7ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.210408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31778799-3399-4255-a69b-70cd194e7ef3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.216900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 378/744] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:24.222370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3b91-577c-44ea-a1ca-b5f05a77dc30 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.222944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3b91-577c-44ea-a1ca-b5f05a77dc30 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.223693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a3b91-577c-44ea-a1ca-b5f05a77dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.229215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:24.244397 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-244a3b91-577c-44ea-a1ca-b5f05a77dc30 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:24.246619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-244a3b91-577c-44ea-a1ca-b5f05a77dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:24.295568 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1da1d-4ec6-480a-ab84-7023b18e8fad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:24.331344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:24.334352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 379/745] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 21:00:24.345661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:24.346399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.346685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.346958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.347801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:24.348111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:24.349856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:24.371531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3b91-577c-44ea-a1ca-b5f05a77dc30 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:24.376763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 367/746] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 16 21:00:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:24.389112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:24.546508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a3b91-577c-44ea-a1ca-b5f05a77dc30 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:24.550715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1870d-c3d3-4958-8e17-7c3d3d5c4110 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:24.581485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:24.588512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f888d-7e62-4ba2-8d04-48cfe22db793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:24.589207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f888d-7e62-4ba2-8d04-48cfe22db793 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.589567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f888d-7e62-4ba2-8d04-48cfe22db793 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.589902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f888d-7e62-4ba2-8d04-48cfe22db793 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.590562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f888d-7e62-4ba2-8d04-48cfe22db793 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:24.591346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:24.591936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f888d-7e62-4ba2-8d04-48cfe22db793 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:24.592047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.592289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.592563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.611370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 380/747] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:24 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:24.613065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7901b2-1e4f-4ae9-bf3f-df7920eed178 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.613560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7901b2-1e4f-4ae9-bf3f-df7920eed178 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.613981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7901b2-1e4f-4ae9-bf3f-df7920eed178 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.619714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 381/748] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:24.621732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f64c-c855-4ca8-8ce7-e5df95e3ac2f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.622222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f64c-c855-4ca8-8ce7-e5df95e3ac2f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.622647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f64c-c855-4ca8-8ce7-e5df95e3ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.646977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6568f64c-c855-4ca8-8ce7-e5df95e3ac2f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:24.648575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6568f64c-c855-4ca8-8ce7-e5df95e3ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:24.685723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:24.712629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:24.714723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:24.741280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 382/749] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:24.766282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f64c-c855-4ca8-8ce7-e5df95e3ac2f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:24.824265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 368/750] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 21:00:24.837278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:24.877930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f64c-c855-4ca8-8ce7-e5df95e3ac2f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:24.915149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:24.945177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:24.946936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:24.947694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:24.948227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:24.961670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:24.965141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:24.974950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:24.975907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:24.976785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:24.977999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 383/751] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:24.985130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:24.995149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a3752-7ea4-4b16-a2b1-13d8f8db8c5b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.046771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.048535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.049118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.049568 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.064032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.066017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:25.090045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:25.091154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:25.092035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:25.092035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:25.092035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:25.092035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:25.093700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 369/752] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:25.101679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:25.123095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d34e1-6bb8-47a5-9eb0-4b6dee87316c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.161083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.162237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.162717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.163185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.164116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:25.164787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.166586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.176712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 384/753] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:25.182414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:25.224521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163626a7-6e64-48ab-81fc-c44cf67cdf72 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.228425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:25.262151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.263532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.263823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.264106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.264864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:25.265178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.266579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.270457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:25.296684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 370/754] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:25.302281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:25.340463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf0677-b4f4-45ce-8718-f108581818be None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.381565 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.388210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.388210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.388210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.396683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.398587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:25.419427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:25.420356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:25.421263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:25.421263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:25.421263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:25.421263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:25.421263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 385/755] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:25.426307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:25.532565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694308d-d007-4f48-9a68-c8767ceb6a87 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.539388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:25.552644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7836294-d0c4-40ba-a82b-690483539206 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.592592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.594154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.594651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.595131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.596263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:25.596782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.598894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.613671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 386/756] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:25.619153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:25.644922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.645739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.646019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.646294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.665367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.666917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:25.704729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:25.705724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:25.706616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 371/757] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:25.711355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:25.731115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956652c-1ad7-4979-afa2-e2801be25c20 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.768509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.769455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.769600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.769859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.784222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.784222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:25.796072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:25.797072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:25.798040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 387/758] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:25.806002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:25.815241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:25.818318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:25.910464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745f08f-350a-473f-ba05-5ed6e395db65 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.930120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1d2fae-97d3-4ada-b586-18c4cf601dfa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:25.947730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:25.949391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:25.949883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:25.950362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:25.951420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:25.952105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:25.953778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:25.976246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 388/759] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:25.978107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:26.013866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:26.014538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.014812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.015084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.015873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:26.016207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:26.017641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:26.044039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 372/760] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:26.049723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:26.055219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:26.090673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29687d-5588-498d-8327-7fc8e7a8a43d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:26.127696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:26.128867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.129359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.129838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.141360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:26.143090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:26.162603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:26.163536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:26.164462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:26.164462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:26.164462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:26.164462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:26.166678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 389/761] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:26.172862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:26.246522 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd55cb4-615e-4eaa-8166-a05071d429fd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:26.269182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:26.284110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a92e-3535-4dba-9931-0767e8ca4c6c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:26.304880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:26.305549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.305838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.306307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.306947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=759ce183ee164679ba3d16860c088804) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:26.307261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:26.309368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:26.313103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:26.324987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 373/762] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:26 2022] GET /identity/v3/role_assignments?user.id=759ce183ee164679ba3d16860c088804&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:26.327427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:26.328416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.328968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.329454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.330417 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:26.331017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:26.332843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:26.346824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 390/763] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:26.353037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:26.487948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5897c-3925-48b5-bf83-32c35a0834c0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:26.528635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d0abd-b3ee-49ac-946b-329a7d70c1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:26.529836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0abd-b3ee-49ac-946b-329a7d70c1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.530355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0abd-b3ee-49ac-946b-329a7d70c1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.530836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d0abd-b3ee-49ac-946b-329a7d70c1b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.538945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0abd-b3ee-49ac-946b-329a7d70c1b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:26.540809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d0abd-b3ee-49ac-946b-329a7d70c1b3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-869d0abd-b3ee-49ac-946b-329a7d70c1b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:26.558666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:26.559687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:26.560630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:26.563209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 374/764] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:26.569352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:26.631091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14413e-4b72-44d9-af8a-e3a23e63a4f1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.631415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14413e-4b72-44d9-af8a-e3a23e63a4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.631653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14413e-4b72-44d9-af8a-e3a23e63a4f1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.633588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 375/765] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:26.640501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fb44-d485-48ba-b5ef-fde1feea4369 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.640916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fb44-d485-48ba-b5ef-fde1feea4369 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.641453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287fb44-d485-48ba-b5ef-fde1feea4369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.667410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6287fb44-d485-48ba-b5ef-fde1feea4369 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:26.670148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6287fb44-d485-48ba-b5ef-fde1feea4369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:26.724126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab9c0-ca7b-41ef-8388-32494aa23f9a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:26.731319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:26.801876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a92cb-de2f-4a6d-9b4f-c77a92c4c292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:26.802564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a92cb-de2f-4a6d-9b4f-c77a92c4c292 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.802847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a92cb-de2f-4a6d-9b4f-c77a92c4c292 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.803122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a92cb-de2f-4a6d-9b4f-c77a92c4c292 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.803939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a92cb-de2f-4a6d-9b4f-c77a92c4c292 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:26.804278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a92cb-de2f-4a6d-9b4f-c77a92c4c292 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:26.805782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a92cb-de2f-4a6d-9b4f-c77a92c4c292 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:26.813963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 376/766] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:26.832520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 391/767] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:26.838287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287fb44-d485-48ba-b5ef-fde1feea4369 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:26.857621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca71e8d-a735-4aa2-a61e-3ae70880f44f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.857928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca71e8d-a735-4aa2-a61e-3ae70880f44f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.858183 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca71e8d-a735-4aa2-a61e-3ae70880f44f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.859702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 392/768] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:26.864584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac455c7-ac82-415a-913a-f2b4f468894d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:26.864873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac455c7-ac82-415a-913a-f2b4f468894d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:26.865143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac455c7-ac82-415a-913a-f2b4f468894d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:26.887360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3ac455c7-ac82-415a-913a-f2b4f468894d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:26.888818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3ac455c7-ac82-415a-913a-f2b4f468894d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:26.932788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:26.964413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287fb44-d485-48ba-b5ef-fde1feea4369 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:26.970064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 393/769] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:26.971139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac455c7-ac82-415a-913a-f2b4f468894d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.021096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.022387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.022785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.023064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/c1e4d798757a41cfad3454940c12bcab/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.027112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=c1e4d798757a41cfad3454940c12bcab, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.028581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.046399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 377/770] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:26 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/c1e4d798757a41cfad3454940c12bcab/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:27.047923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.084344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:27.125636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac455c7-ac82-415a-913a-f2b4f468894d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.181845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a7200-4f8c-479b-b5c3-787b9bd7b59a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.197953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.198825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.199453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.199453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.222878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.223232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:27.223397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.223397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.223397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.223397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.225711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:27.238652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:27.240873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:27.242897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:27.244435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:27.254148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:27.256222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 378/771] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:27.258296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 394/772] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:27.258442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.258592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.297819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:27.372887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025562cc-2a1d-4713-bb14-a750e373ecb4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.395480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:27.407765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.408152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d4265-5f29-4c41-9b7a-a5e46dbffd33 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.408521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.408803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.409079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.409787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:27.410091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.411481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.416597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 395/773] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:27.429208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.444866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.445537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.445810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.446081 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.446829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:27.447136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.449183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.458894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 379/774] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:27.464878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.582879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3820e-6da6-4716-b461-f3a323463e78 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.611485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:27.619142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a92ca-6f93-4228-9de7-328b85ede894 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.625162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a966fb-0fab-4449-aecc-ed353eaebae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.625987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a966fb-0fab-4449-aecc-ed353eaebae1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.626342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a966fb-0fab-4449-aecc-ed353eaebae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.626688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a966fb-0fab-4449-aecc-ed353eaebae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.638516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a966fb-0fab-4449-aecc-ed353eaebae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.640093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a966fb-0fab-4449-aecc-ed353eaebae1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.657189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8e221-0bbe-488d-b977-d03e1529c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-18a966fb-0fab-4449-aecc-ed353eaebae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:27.657963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:27.658834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:27.659705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:27.659705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:27.659705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:27.659705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:27.660521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e221-0bbe-488d-b977-d03e1529c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.661000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e221-0bbe-488d-b977-d03e1529c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.661465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8e221-0bbe-488d-b977-d03e1529c9b5 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.662359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e221-0bbe-488d-b977-d03e1529c9b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:27.662869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e221-0bbe-488d-b977-d03e1529c9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.663687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 380/775] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:27.664714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8e221-0bbe-488d-b977-d03e1529c9b5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.665009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024892-ff7c-4a65-914d-d8a69074f116 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.665302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024892-ff7c-4a65-914d-d8a69074f116 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.665585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6024892-ff7c-4a65-914d-d8a69074f116 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.667622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 381/776] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:27.672240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 396/777] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:27.672437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024892-ff7c-4a65-914d-d8a69074f116 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.673948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9ac0e-bb57-457b-9324-f3ed4d058f6a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.674463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9ac0e-bb57-457b-9324-f3ed4d058f6a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.674947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9ac0e-bb57-457b-9324-f3ed4d058f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.677119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:27.694910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b4b9ac0e-bb57-457b-9324-f3ed4d058f6a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:27.696694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b4b9ac0e-bb57-457b-9324-f3ed4d058f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:27.774440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 397/778] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:27.775778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9ac0e-bb57-457b-9324-f3ed4d058f6a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.798094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6024892-ff7c-4a65-914d-d8a69074f116 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.842944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.843616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.843900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.844193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.844942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:27.845253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.846732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.860619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 382/779] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:27.866119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.891393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:27.902886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9ac0e-bb57-457b-9324-f3ed4d058f6a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:27.935396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:27.939315 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:27.940677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:27.941224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:27.941763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:27.942812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] RBAC: Adding query filter params (interface=public, service_id=7a53902d3e7d4702bc2c1266bc062cb8, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:27.943368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:27.945059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:27.954029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 398/780] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/endpoints?service_id=7a53902d3e7d4702bc2c1266bc062cb8&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:27.955116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:27.982700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518806f-77aa-45f5-b997-b498b8a20e28 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.027190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.029240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.029696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.030111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.031072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.033128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:28.048439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:28.049652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:28.050699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:28.058699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 383/781] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:28.058699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.092704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2048f-4c62-468b-b25c-56629cca02ff None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.138782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.139849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.140302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.140716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.151406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.154168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.168419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656cbf1-ffc0-416b-8fb3-5c06cb87a8c9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:28.174043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:28.175156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:28.176333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:28.179005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 399/782] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:00:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:28.179921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.200385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:28.205647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:28.216656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.217565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.217983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.218322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.219160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.220938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.232677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 384/783] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:28.233775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.311834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ad0b3-3b8e-40ce-ae18-03e679ea4d18 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.353129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.354204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.355304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.355783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.357038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:28.357560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.359454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.366496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 400/784] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:28.373164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.452498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40345e8d-f16a-434a-853c-7127fc0da807 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.477878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:28.503293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf9fb-a48a-4942-aaaa-b8139285d8f1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.531931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.532650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.532932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.533271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.534050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:28.534363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.536121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.545229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.547239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.547726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.548215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.549147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] RBAC: Adding query filter params (type=network) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:28.549649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.551369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.562340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 401/785] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:28.563586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.574162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 385/786] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:28.581339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.657084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:28.691277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767adead-990f-48ad-8893-520e1db7c67c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.720990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600000c-b264-499f-96ab-42fd97e6e3fa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.735763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.737142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.737668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.738086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.739205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] RBAC: Adding query filter params (interface=public, service_id=b858be2cb2f34c24a7583871e746e70b, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:28.739660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.741442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.749413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 402/787] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/endpoints?service_id=b858be2cb2f34c24a7583871e746e70b&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:28.754719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.764051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.764884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.765161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.765431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.768490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:28.787615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.789105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:28.831072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:28.832017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:28.833041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:28.833041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:28.833041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:28.833041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:28.838660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 386/788] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:28.844887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:28.934177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a11246-959f-4e18-a3db-a3efb27d5a04 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.979169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045593f-4471-4a73-b044-7985439ad54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:28.980288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045593f-4471-4a73-b044-7985439ad54c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.980722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045593f-4471-4a73-b044-7985439ad54c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.981136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045593f-4471-4a73-b044-7985439ad54c None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.981833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045593f-4471-4a73-b044-7985439ad54c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:28.982677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f391467-3b73-4cae-8ea0-d25f0254efca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:28.983223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045593f-4471-4a73-b044-7985439ad54c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:28.984400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:28.996802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 403/789] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:28.996802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885974-48db-4da9-8b74-dc58cb4a64c7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:28.996802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885974-48db-4da9-8b74-dc58cb4a64c7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:28.996802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885974-48db-4da9-8b74-dc58cb4a64c7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:28.996802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 404/790] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:29.003844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0b67-b1a7-4f89-b682-0538a1786411 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.003844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0b67-b1a7-4f89-b682-0538a1786411 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.003844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f0b67-b1a7-4f89-b682-0538a1786411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.035353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b78f0b67-b1a7-4f89-b682-0538a1786411 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:29.036621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b78f0b67-b1a7-4f89-b682-0538a1786411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:29.073154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:29.074798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.075089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.075396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.076238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:29.076555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:29.078150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:29.109324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 387/791] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:29.115037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:29.127641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:29.128735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 405/792] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:29.165359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f0b67-b1a7-4f89-b682-0538a1786411 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:29.284894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bda021-3521-4d8a-9d39-7da180dfb1c8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:29.342651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f0b67-b1a7-4f89-b682-0538a1786411 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:29.352058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:29.353788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.354504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.356163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.367844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:29.369704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:29.398959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:29.399929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:29.400893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:29.403852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 388/793] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:29.415092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:29.448204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:29.449077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.449394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.449650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.460123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:29.486602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:29.507073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:29.508093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:29.508963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:29.515519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 406/794] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:29.516483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:29.612208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b609521-bb43-4ebc-aab4-fb82431f58cf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:29.620009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:29.655829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ff9a4-6f2f-49aa-9ebc-601ab49c123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:29.656622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff9a4-6f2f-49aa-9ebc-601ab49c123a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.656908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff9a4-6f2f-49aa-9ebc-601ab49c123a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.657188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ff9a4-6f2f-49aa-9ebc-601ab49c123a None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.658207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ff9a4-6f2f-49aa-9ebc-601ab49c123a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:29.658523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ff9a4-6f2f-49aa-9ebc-601ab49c123a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:29.660982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ff9a4-6f2f-49aa-9ebc-601ab49c123a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:29.676684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 389/795] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:29.678036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43b9d-a05b-4971-bf67-de9e9dbc7b0d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.678329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43b9d-a05b-4971-bf67-de9e9dbc7b0d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.678606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43b9d-a05b-4971-bf67-de9e9dbc7b0d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.680073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 390/796] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:29.686152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9841d-a3e8-4e28-8acb-6c518190ce6b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:29.691206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a43b9d-a05b-4971-bf67-de9e9dbc7b0d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:29.728032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00195b02-f116-476a-8f57-a0a75f3d0c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:29.728977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00195b02-f116-476a-8f57-a0a75f3d0c91 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.729358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00195b02-f116-476a-8f57-a0a75f3d0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.729846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00195b02-f116-476a-8f57-a0a75f3d0c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.730706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00195b02-f116-476a-8f57-a0a75f3d0c91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:29.731108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00195b02-f116-476a-8f57-a0a75f3d0c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:29.732946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00195b02-f116-476a-8f57-a0a75f3d0c91 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:29.744117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 407/797] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:29.747158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d8761-8766-4e51-b08a-ed710099be97 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.747495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d8761-8766-4e51-b08a-ed710099be97 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.748142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d8761-8766-4e51-b08a-ed710099be97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.767834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cb7d8761-8766-4e51-b08a-ed710099be97 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:29.769218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cb7d8761-8766-4e51-b08a-ed710099be97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:29.810998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:29.841786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a43b9d-a05b-4971-bf67-de9e9dbc7b0d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:29.867884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 408/798] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:29.868513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d8761-8766-4e51-b08a-ed710099be97 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:29.899742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:29.903580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:29.903860 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:29.904116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/804e3317fa4f460aa7078b94db562934/roles/744abd0f005f43e8bc93a7267c81c7bd` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:29.929380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=804e3317fa4f460aa7078b94db562934, role_id=744abd0f005f43e8bc93a7267c81c7bd)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:29.931983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:29.943120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:29.954114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 391/799] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:29 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/804e3317fa4f460aa7078b94db562934/roles/744abd0f005f43e8bc93a7267c81c7bd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:29.955254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.045644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d8761-8766-4e51-b08a-ed710099be97 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.103172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66a506-f44d-4f01-ab3e-dc2e2eb066a1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.141567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.142369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.142575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.142848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.153843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:30.161991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.164863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.165395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.165890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.174391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:30.175871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:30.182621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:30.199349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:30.200602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:30.201556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:30.207469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 392/800] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:30.220109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:30.221138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:30.222464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:30.222464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:30.222464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:30.222464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:30.222464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 409/801] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:30.224735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.236326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.340334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2627ec-0be8-4c06-a92f-1f8e565d5176 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.368981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e78d56-39a3-4950-b3e2-724fcff58c66 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.373740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:30.378872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.380879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.381364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.381865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.383388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:30.384329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:30.386783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:30.399368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 393/802] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:30.405428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.415706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.416412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.416737 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.417015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.418326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:30.418686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:30.425366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:30.459728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 410/803] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:30.466033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.505701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:30.553279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ff1e2-cac5-443b-b747-056ba0f9f596 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.609748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.610639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.610827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.611104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.626644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:30.628121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:30.652366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:30.653289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:30.654785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:30.654785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:30.654785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:30.654785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:30.654785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 394/804] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:30.658967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.734115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3728ce-0b9f-4346-a2a3-224b8e5ca50e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.770456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30bd2-3758-4f4f-9244-bb3acadb99c8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.778797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:30.807617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.808397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.808683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.808962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.809854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:30.810483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:30.811870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:30.825399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 395/805] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:30.830888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.853012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.853897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.854185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.854460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.877076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:30.878596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:30.925014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:30.925952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:30.927313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 411/806] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 461 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:30.933698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:30.934535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c737d8-ad35-48d9-ab7b-c7bc141ea6b2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:30.972029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:30.972866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:30.973149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:30.973428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:30.981809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:30.983255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:30.999151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:31.000136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:00:31.001094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:31.002755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 396/807] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:00:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:31.007062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.016517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:31.092669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:31.119798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d54b9-546a-418f-8cb9-0d525d3a6dc8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:31.159235 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602452d1-3ff4-4cfc-8bc0-7171833d709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:31.160047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602452d1-3ff4-4cfc-8bc0-7171833d709f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.160380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602452d1-3ff4-4cfc-8bc0-7171833d709f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.160663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602452d1-3ff4-4cfc-8bc0-7171833d709f None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.161499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602452d1-3ff4-4cfc-8bc0-7171833d709f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:31.164616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602452d1-3ff4-4cfc-8bc0-7171833d709f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:31.166285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602452d1-3ff4-4cfc-8bc0-7171833d709f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:31.192019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 397/808] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:31.194597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcaca-7081-4d15-8a67-264feeb5cfea None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.195087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcaca-7081-4d15-8a67-264feeb5cfea None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.195558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcaca-7081-4d15-8a67-264feeb5cfea None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.197368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 398/809] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:31.198892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfcaca-7081-4d15-8a67-264feeb5cfea None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.230004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3daf5-0f16-4597-9f1f-198172fecc63 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:31.267244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ab9e2-6720-48d8-93a3-d81f52fcab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:31.267922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab9e2-6720-48d8-93a3-d81f52fcab13 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.268250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab9e2-6720-48d8-93a3-d81f52fcab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.268535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ab9e2-6720-48d8-93a3-d81f52fcab13 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.269376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab9e2-6720-48d8-93a3-d81f52fcab13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:31.269797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab9e2-6720-48d8-93a3-d81f52fcab13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:31.271233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81ab9e2-6720-48d8-93a3-d81f52fcab13 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:31.291155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 412/810] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 16 21:00:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:31.296471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9d41b-0b5e-4de0-9b0b-dbf64feb9511 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.298846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9d41b-0b5e-4de0-9b0b-dbf64feb9511 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.299331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9d41b-0b5e-4de0-9b0b-dbf64feb9511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.308652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:31.317481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-12a9d41b-0b5e-4de0-9b0b-dbf64feb9511 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:31.319056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-12a9d41b-0b5e-4de0-9b0b-dbf64feb9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:31.329000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfcaca-7081-4d15-8a67-264feeb5cfea None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:31.370545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:31.371390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.371682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.371977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.395393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 413/811] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:31.396633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9d41b-0b5e-4de0-9b0b-dbf64feb9511 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.422322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:31.442685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:31.444164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:31.500256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9d41b-0b5e-4de0-9b0b-dbf64feb9511 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:31.531260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:31.535673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:31.536958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.537443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.537968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.549556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:31.551386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:31.554328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 399/812] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:00:31.555233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:31.570539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:31.571448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:31.572754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:31.572754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:31.572754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:31.572754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:31.575224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 414/813] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:31.576306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.641511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:31.685827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d33ef-7dca-42d2-b1c9-d9355b173502 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:31.693723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98759127-8b2f-4562-8cb1-415a7f59116a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:31.723152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3c19a-93b2-4340-8cf7-e4f920d353ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:31.724332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c19a-93b2-4340-8cf7-e4f920d353ca None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.724677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c19a-93b2-4340-8cf7-e4f920d353ca None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.725024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3c19a-93b2-4340-8cf7-e4f920d353ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.736121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3c19a-93b2-4340-8cf7-e4f920d353ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:31.737212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:31.737622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b3c19a-93b2-4340-8cf7-e4f920d353ca None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:31.738016 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.738302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.738582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.739238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:31.740630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:31.753234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:31.754242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 21:00:31.755094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:31.759564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 400/814] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:31.760605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.817195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e9b3c19a-93b2-4340-8cf7-e4f920d353ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:31.873563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:31.874528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:31.875443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:31.875443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:31.875443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:31.875443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:31.875663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fca4be-3a3e-4e5f-89b4-c89b9dc458d5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:31.879471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 415/815] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:31.880813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13d104-9cac-457f-9b0b-f69865971f1b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.881099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13d104-9cac-457f-9b0b-f69865971f1b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.881374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13d104-9cac-457f-9b0b-f69865971f1b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.882767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 416/816] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:31.883373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13d104-9cac-457f-9b0b-f69865971f1b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.912019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:31.913048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:31.913527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:31.914051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:31.914958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:31.915263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:31.916666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:31.931744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 401/817] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:31.932616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:31.996590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13d104-9cac-457f-9b0b-f69865971f1b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.013513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.032523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19882575-309f-4d56-aee8-89f706ab3cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.033190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19882575-309f-4d56-aee8-89f706ab3cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.033469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19882575-309f-4d56-aee8-89f706ab3cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.033741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19882575-309f-4d56-aee8-89f706ab3cb7 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.034435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19882575-309f-4d56-aee8-89f706ab3cb7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:32.034741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19882575-309f-4d56-aee8-89f706ab3cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.036088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19882575-309f-4d56-aee8-89f706ab3cb7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.045681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 417/818] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:32.045681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60357-1838-4d66-b67d-4e59207997ed None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.045681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60357-1838-4d66-b67d-4e59207997ed None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.045681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd60357-1838-4d66-b67d-4e59207997ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.049580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9fc8-88f6-4e0a-ae99-d86ea76bb657 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.059520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bcd60357-1838-4d66-b67d-4e59207997ed None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:32.060105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.060836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bcd60357-1838-4d66-b67d-4e59207997ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:32.088613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.089337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.089624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.089903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.090645 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:32.090932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.092395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.103809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 402/819] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:32.105185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.140494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 418/820] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:32.148052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60357-1838-4d66-b67d-4e59207997ed None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.220034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594e8e7-4d40-4efd-a414-eba6f4b6552c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.256380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd60357-1838-4d66-b67d-4e59207997ed None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.260037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.261593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.262318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.262747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.268807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.269917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.271664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:32.286917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:32.288026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:32.288984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 403/821] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:32.289462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.302469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.303236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.303432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.303709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.304468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:32.304783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.306155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.311597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 419/822] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:32.313032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.321948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.406314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5072512-5565-444e-a8cb-2712e5998e16 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.422108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a514c1-3ce3-4e68-af6f-4e1fa04e40b6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.443962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.444789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.445071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.445342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.451998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.453474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.456165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.457003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.457282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.457552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] PATH_INFO: `/v3/services/network` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.458195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.459529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:32.468688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:32.469720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:32.470686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 404/823] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:32.471193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:32.471755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:32.472934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:32.474730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 420/824] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:32.475883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.514147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.562892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.575977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce3cb7-3bd1-44b7-a420-392ea88796be None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.576125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a3623-6535-4884-af96-ec8dd447535e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.610789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c998a98-1cd2-4318-b370-208bf344118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.611338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.611463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998a98-1cd2-4318-b370-208bf344118c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.611721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998a98-1cd2-4318-b370-208bf344118c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.611988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.612079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998a98-1cd2-4318-b370-208bf344118c None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.612304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.612580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.612811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c998a98-1cd2-4318-b370-208bf344118c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:32.613123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c998a98-1cd2-4318-b370-208bf344118c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.613312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.614563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c998a98-1cd2-4318-b370-208bf344118c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.614655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.627337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 405/825] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:32.628716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08030b15-6d22-4a02-8e89-92eada543dbb None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.628997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08030b15-6d22-4a02-8e89-92eada543dbb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.629350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08030b15-6d22-4a02-8e89-92eada543dbb None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.630767 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 406/826] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:32.631460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08030b15-6d22-4a02-8e89-92eada543dbb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.636895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 421/827] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:00:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:32.645891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.756622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08030b15-6d22-4a02-8e89-92eada543dbb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.763577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.774325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84113b2-0fd9-424a-a548-f9c04878f9be None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.803539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.804236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.804525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.804810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.805662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:32.805966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.807420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.821316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a342c-b6ee-4172-b13e-ec89c29bb3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.821835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 407/828] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:32.822008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a342c-b6ee-4172-b13e-ec89c29bb3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.822279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a342c-b6ee-4172-b13e-ec89c29bb3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.822507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.822615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a342c-b6ee-4172-b13e-ec89c29bb3e8 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.823256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a342c-b6ee-4172-b13e-ec89c29bb3e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:32.824124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a342c-b6ee-4172-b13e-ec89c29bb3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.825536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a342c-b6ee-4172-b13e-ec89c29bb3e8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.827904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:32.831559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 422/829] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:32.832908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bedf6d-57a2-4ffa-8096-726c313549df None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.833200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bedf6d-57a2-4ffa-8096-726c313549df None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.833836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bedf6d-57a2-4ffa-8096-726c313549df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.851679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d0bedf6d-57a2-4ffa-8096-726c313549df None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:32.853258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d0bedf6d-57a2-4ffa-8096-726c313549df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:32.926753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 423/830] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:32.927607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bedf6d-57a2-4ffa-8096-726c313549df None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:32.935472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061874d-99c2-41f6-b3b7-7232695ff400 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:32.973453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:32.974728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:32.975013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:32.975285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/759ce183ee164679ba3d16860c088804/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:32.977267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=759ce183ee164679ba3d16860c088804, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:32.978699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:32.993142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 408/831] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:32 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/759ce183ee164679ba3d16860c088804/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:00:33.005223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:33.039133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:33.054216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bedf6d-57a2-4ffa-8096-726c313549df None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:33.095486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:33.096155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:33.096478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:33.096753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:33.097592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=c1e4d798757a41cfad3454940c12bcab) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:33.097960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:33.099720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:33.103674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:33.107439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 424/832] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/role_assignments?user.id=c1e4d798757a41cfad3454940c12bcab&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:33.108479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:33.162377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770d9f-27db-42be-8eb2-4d3588064954 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:33.231862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:33.232560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:33.232824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:33.232991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:33.233693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:33.234003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:33.235427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:33.242074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 409/833] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:33.248730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9b1c6-5431-487c-9960-7eda78a35f80 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:33.249353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:33.303445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:33.305063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:33.305063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:33.305240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:33.330566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:33.341667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:33.342622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:00:33.343454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:33.348399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 425/834] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:00:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:33.352811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:33.379311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:33.403627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8093e8-e95f-44a1-81d9-4c64d8171ef8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:33.431985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:33.441851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:33.442835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:33.443335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:33.443815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:33.444799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:33.446382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:33.475090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 410/835] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:00:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:33.491232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14376a39-f998-4658-b7ad-d13939a89954 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:33.555901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:33.557077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:33.557589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:33.558700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:33.559788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:33.560359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:33.562042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:33.575090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 426/836] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:00:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:33.580431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:33.699411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b09f20-befe-4287-a141-967bb52b065e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:33.735046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:33.735851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:33.736134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:33.736448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:33.747761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:33.749266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:33.767821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:33.768755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:33.769657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:33.769657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:33.769657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:33.769657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:33.769657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 411/837] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:33.775552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:33.882186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:33.924003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc8666-0457-4da9-aa1c-5169915cf80f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:33.962407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:33.963082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:33.963370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:33.963651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:33.965004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:33.965318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:33.966696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:33.980994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 427/838] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:33.986705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:34.025932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:34.097999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb4f25-fc09-411a-b603-879ab60d7753 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:34.137315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:34.138035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:34.138321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:34.138656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:34.148824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:34.150292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:34.165589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:34.166549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:34.167644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 412/839] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:00:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:34.172952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:34.280819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21631151-e6a7-48bd-a828-8819c025fe4f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:34.311390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:34.318143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:34.319353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:34.320058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:34.320361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:34.321230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:34.321590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:34.323093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:34.341998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 428/840] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 16 21:00:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:34.347175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:34.445950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:34.457956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced30bca-2656-4e47-975f-ef33419fe252 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:34.498535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:34.499254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:34.499540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:34.499820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:34.570000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:34.571461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:34.675022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:34.679646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 413/841] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:00:34.685841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:34.793747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421fd1-231f-4c22-86f9-ae63f5090c37 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:34.829326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c2375-bdda-4f1f-9558-448ccc288a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:34.830119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c2375-bdda-4f1f-9558-448ccc288a49 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:34.830396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c2375-bdda-4f1f-9558-448ccc288a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:34.830666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c2375-bdda-4f1f-9558-448ccc288a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:34.842110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c2375-bdda-4f1f-9558-448ccc288a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:34.843560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c2375-bdda-4f1f-9558-448ccc288a49 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8f0c2375-bdda-4f1f-9558-448ccc288a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:34.862976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:34.863901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:34.864838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:34.864838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:34.864838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:34.864838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:34.864838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 429/842] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:34.869723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:34.974001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777368d-c43b-47f9-a829-02cd54e260c8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.010635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.011545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.011659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf6dc-751c-4414-a90c-29866d726837 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.011887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.011992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf6dc-751c-4414-a90c-29866d726837 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.012163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.012286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bf6dc-751c-4414-a90c-29866d726837 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.012921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:35.013228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:35.013833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 430/843] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:35.014598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:35.018782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a5ae-adf8-4b12-9322-abf8db28e900 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.019072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a5ae-adf8-4b12-9322-abf8db28e900 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.019349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9a5ae-adf8-4b12-9322-abf8db28e900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.028223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 414/844] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:35.033723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.040990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0fe9a5ae-adf8-4b12-9322-abf8db28e900 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:35.042429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0fe9a5ae-adf8-4b12-9322-abf8db28e900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:35.088247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.104130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.136371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 431/845] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:35.154942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9a5ae-adf8-4b12-9322-abf8db28e900 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.160980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255ae3-b86f-4d30-8005-1ae6726d9c54 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.202710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.204386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.204923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.205771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.217271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:35.218897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:35.238347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:35.239381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:35.240296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:35.244340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 415/846] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:35.245524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.281253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9a5ae-adf8-4b12-9322-abf8db28e900 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.319419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.321065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.321566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.322096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.323183 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:35.325537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:35.339525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:35.340785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:35.341636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:35.348513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 432/847] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:35.351053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.357502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e92e04-3648-4adf-be86-b3ef81f775b7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.377706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.395802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.400642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.401544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.401943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.402384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.403191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:35.403507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:35.405765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:35.426051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 416/848] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:35.427119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.470166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91735-3ce7-4def-86ac-7775897feffd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.506827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5d0ac-3d59-4a42-8bbd-fa7cd7d830a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.507497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d0ac-3d59-4a42-8bbd-fa7cd7d830a8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.507779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d0ac-3d59-4a42-8bbd-fa7cd7d830a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.508051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5d0ac-3d59-4a42-8bbd-fa7cd7d830a8 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.508787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5d0ac-3d59-4a42-8bbd-fa7cd7d830a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:35.509089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5d0ac-3d59-4a42-8bbd-fa7cd7d830a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:35.510442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5d0ac-3d59-4a42-8bbd-fa7cd7d830a8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:35.515178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 433/849] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:35.516427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded2c1-7c9c-429a-9c2b-1a901af29954 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.516715 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded2c1-7c9c-429a-9c2b-1a901af29954 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.516992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded2c1-7c9c-429a-9c2b-1a901af29954 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.518424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 434/850] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:35.522825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded2c1-7c9c-429a-9c2b-1a901af29954 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.546536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f21dda-45df-4d1e-bbf2-f8b1ae0064b7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.583438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41624d-0860-4981-8d76-027d0e750610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.584096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41624d-0860-4981-8d76-027d0e750610 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.584426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41624d-0860-4981-8d76-027d0e750610 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.584706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41624d-0860-4981-8d76-027d0e750610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.585533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41624d-0860-4981-8d76-027d0e750610 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=804e3317fa4f460aa7078b94db562934) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:35.585842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41624d-0860-4981-8d76-027d0e750610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:35.587278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41624d-0860-4981-8d76-027d0e750610 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:35.598210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 417/851] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/role_assignments?user.id=804e3317fa4f460aa7078b94db562934&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:35.599747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ce35-f198-4181-91b9-2f61c8768c47 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.600036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ce35-f198-4181-91b9-2f61c8768c47 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.600404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2ce35-f198-4181-91b9-2f61c8768c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.632314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-85f2ce35-f198-4181-91b9-2f61c8768c47 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:35.633628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-85f2ce35-f198-4181-91b9-2f61c8768c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:35.661228 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.669748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded2c1-7c9c-429a-9c2b-1a901af29954 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.677630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.717435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 418/852] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:35.720510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.721179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.721462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.721734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.721828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becc4cd-9d78-41cf-a65f-c5e0ad5f6efb None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.722086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becc4cd-9d78-41cf-a65f-c5e0ad5f6efb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.722366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1becc4cd-9d78-41cf-a65f-c5e0ad5f6efb None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.722458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:35.722722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:35.724056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 419/853] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:35.724430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:35.728667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f63207-26a5-4be3-8ac9-39f2dca81a2a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.728959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f63207-26a5-4be3-8ac9-39f2dca81a2a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.729240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f63207-26a5-4be3-8ac9-39f2dca81a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.736320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 435/854] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:35.749542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.751548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d6f63207-26a5-4be3-8ac9-39f2dca81a2a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:35.752937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d6f63207-26a5-4be3-8ac9-39f2dca81a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:35.843845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 420/855] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:35.867001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f63207-26a5-4be3-8ac9-39f2dca81a2a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.881054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04beb9-99d5-41f4-b251-5743870c25b2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:35.929699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:35.929699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:35.929991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:35.930238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:35.942020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:35.950789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:35.951739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:35.952655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 436/856] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:35.958828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:35.991437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.992945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:35.997818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f63207-26a5-4be3-8ac9-39f2dca81a2a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.085085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e978-e771-4cc3-967c-bb6ad5cd5978 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.124820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.125857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.126336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.126811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.128482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:36.129013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.131039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.144398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 437/857] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:36.152979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:36.168376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.169318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.170032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.170375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.171423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.173094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:36.190949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:36.192064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:36.192976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 421/858] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jun 16 21:00:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:36.197883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:36.264071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:36.287678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c7f0-9cd8-4618-825a-be77d5c135d2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.321928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e6564-bb4d-4cb5-9640-ee0c1e5163fb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.327091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.327978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.328360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.328711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.341037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.342766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.360674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.361333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.361613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.361888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:36.361986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:36.362801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:36.363674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:36.363674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:36.363674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:36.363674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:36.363892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:36.363892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.364455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.367839 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 438/859] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:36.368731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:36.369507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 422/860] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:36.375428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:36.405719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:36.490609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6e728-2e39-4db5-aaac-796c1bdaaeb4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.501983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5bc87-f1ea-4aea-95bf-6c92210e9af8 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.529411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.530383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.530816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.531296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.532328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:36.532802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.534406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.537271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:36.545577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.546262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.546541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.546816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.547519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:36.548287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.550069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.556668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 439/861] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:36.558343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:36.560360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 423/862] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:36.684407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf3ffd-b34b-4561-a176-f68c31875eb5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.723083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.724168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.724478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.724754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.734104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.735579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:36.751877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:36.752851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:36.753768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 440/863] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:00:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:36.759789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:36.868412 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dce85a-7f88-485e-afdc-b311a0656dd4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:36.872501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:36.905503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:36.906600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:36.906883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:36.907159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:36.908035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:36.908382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:36.909886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:36.930989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 424/864] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Jun 16 21:00:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:36.937082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:36.997145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:37.041627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459cc45-009e-46f4-8dfd-e0b324a40e1e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:37.077019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:37.077669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:37.077950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:37.078221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:37.149604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:37.151031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:37.205600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:37.251548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 441/865] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:00:37.257474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:37.361836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ea5a0-fcd9-46c3-b2a5-64b1470f3ab3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:37.402456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:37.403266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:37.403550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:37.403827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:37.414454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:37.415909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:37.434473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:37.435442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:37.436360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:37.436360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:37.436360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:37.436360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:37.436360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 425/866] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:37.442799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:37.549424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36173e71-a3fa-4334-8211-595e140bb016 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:37.585258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:37.586308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:37.586799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:37.587292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:37.588269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:37.588782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:37.590563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:37.610396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 442/867] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:37.617372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:37.620387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:37.724797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440a344-71b4-4d48-97d2-94b66c51e5f4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:37.764391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04f7de-0f85-4749-ab80-eb1ab3d989d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:37.765196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04f7de-0f85-4749-ab80-eb1ab3d989d4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:37.765479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04f7de-0f85-4749-ab80-eb1ab3d989d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:37.765758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04f7de-0f85-4749-ab80-eb1ab3d989d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:37.772778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04f7de-0f85-4749-ab80-eb1ab3d989d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:37.774227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04f7de-0f85-4749-ab80-eb1ab3d989d4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-cb04f7de-0f85-4749-ab80-eb1ab3d989d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:37.789097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:37.790024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:37.790925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 426/868] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:37.798626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:37.821412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:37.917853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd026ef-19de-466e-9de6-28980edb88ad None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:37.958758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:37.959442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:37.959715 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:37.959990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:37.960819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:37.961125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:37.962577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:37.969772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdea8-9972-49dc-a8e7-333ece49e3a3 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:37.970064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdea8-9972-49dc-a8e7-333ece49e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:37.970347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbbdea8-9972-49dc-a8e7-333ece49e3a3 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:37.972019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 427/869] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:37.976225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 443/870] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:37.977367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582df1-60e1-4fac-821c-f2225df8a3a7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:37.977659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582df1-60e1-4fac-821c-f2225df8a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:37.977939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582df1-60e1-4fac-821c-f2225df8a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:37.986063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:38.001549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6c582df1-60e1-4fac-821c-f2225df8a3a7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:38.002940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6c582df1-60e1-4fac-821c-f2225df8a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:38.067926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:38.068289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:38.088390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 428/871] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:38.090519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cfe2-1c9f-47c1-9c82-7afe517ab0c2 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.090830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cfe2-1c9f-47c1-9c82-7afe517ab0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.091365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a9cfe2-1c9f-47c1-9c82-7afe517ab0c2 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.093248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1b54e-85da-409f-8927-a98ae2000658 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:38.096287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 429/872] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:38.098465 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e835d-4e3e-4da7-8e77-c5957b011803 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.098745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e835d-4e3e-4da7-8e77-c5957b011803 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.099278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e835d-4e3e-4da7-8e77-c5957b011803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.116246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c78e835d-4e3e-4da7-8e77-c5957b011803 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:38.117411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c78e835d-4e3e-4da7-8e77-c5957b011803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:38.136472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:38.137160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.137438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.137709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.138545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=759ce183ee164679ba3d16860c088804) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:38.138856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:38.140312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:38.146865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 444/873] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:37 2022] GET /identity/v3/role_assignments?user.id=759ce183ee164679ba3d16860c088804&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:38.147650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:38.220310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 430/874] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:38.245082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e835d-4e3e-4da7-8e77-c5957b011803 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:38.295179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b02d0-910b-4cfd-9d4a-57312a420239 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:38.344143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:38.344920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.345206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.345485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.357718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:38.358927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:38.360984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e835d-4e3e-4da7-8e77-c5957b011803 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:38.367963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:38.369112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:00:38.370114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:38.378268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 445/875] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 16 21:00:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:38.379149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:38.394158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:38.407791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:38.408883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.408883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.409090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.409748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:38.411119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:38.426932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 431/876] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:38 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:00:38.512097 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddc15d-a2fe-45f1-8b9d-6f665a9a6c00 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:38.562051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:38.562751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.563032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.563306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.564066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:38.564407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:38.565798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:38.576434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 446/877] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 16 21:00:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:38.582186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:38.706364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14b6f-9bc4-4545-acc7-5c587303be31 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:38.743652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:38.744483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.744765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.745035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.757961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:38.759437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:38.778442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:38.779490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:38.780485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:38.780485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:38.780485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:38.780485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:38.784238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 432/878] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:38.785580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:38.850011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:38.897608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00904f5e-b878-41aa-9415-4a2939775dbd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:38.941342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e43ac-36f2-435f-863b-7546dedc310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:38.942015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e43ac-36f2-435f-863b-7546dedc310a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.942299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e43ac-36f2-435f-863b-7546dedc310a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.942582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e43ac-36f2-435f-863b-7546dedc310a None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.943310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e43ac-36f2-435f-863b-7546dedc310a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:38.943618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e43ac-36f2-435f-863b-7546dedc310a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:38.945022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4e43ac-36f2-435f-863b-7546dedc310a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:38.958486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 447/879] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:38.963795 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:38.968221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113379-c383-4c69-aea3-3aef3d5de455 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.968519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113379-c383-4c69-aea3-3aef3d5de455 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.968801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c113379-c383-4c69-aea3-3aef3d5de455 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.970416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 448/880] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:38.975595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ccb3-6009-4f10-a216-74d380fbab13 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:38.975889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ccb3-6009-4f10-a216-74d380fbab13 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:38.976204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673ccb3-6009-4f10-a216-74d380fbab13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:38.997021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1673ccb3-6009-4f10-a216-74d380fbab13 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:38.998939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1673ccb3-6009-4f10-a216-74d380fbab13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:39.004152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:39.083572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 449/881] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:39.086742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b513993b-e52d-47ed-a99e-50a7fcd8eafa None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:39.106955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ccb3-6009-4f10-a216-74d380fbab13 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:39.124757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:39.125635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:39.125970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:39.126347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:39.134739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:39.136946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:39.153538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:39.154534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:39.155486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:39.156053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 433/882] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:00:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:39.161024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:39.163780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:39.221053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673ccb3-6009-4f10-a216-74d380fbab13 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:39.263444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:39.264523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:39.265039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:39.265614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:39.266676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:39.268281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:39.275130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:39.283327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf7c00-88bc-4c92-a1a7-6e9226fe602a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:39.292588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 450/883] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:39 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:39.331241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:39.331987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:39.332291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:39.332566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:39.333471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:39.333783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:39.335238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:39.358225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 434/884] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 16 21:00:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:39.364260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:39.486340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85102-88a7-4bac-81da-7f4d95683174 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:39.498661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:39.527113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:39.527893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:39.528065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:39.528372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:39.611667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:39.613399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:39.724347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 451/885] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:39 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:00:39.726178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:39.833003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e20e3f-c7f3-4895-ab24-2363c5a8e2b5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:39.872227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:39.873037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:39.873321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:39.873642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:39.884404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:39.886379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:39.896140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:39.906588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:39.907666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:39.908717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:39.908717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:39.908717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:39.908717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:39.913891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 435/886] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:39.919805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:39.930420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:40.024139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc8c7d-9100-42de-bdd6-722d3a03b324 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:40.061094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:40.061767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.062049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.062316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.063036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:40.063338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:40.064754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:40.080290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 452/887] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:40.085316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:40.189222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71dd42-39bb-4fbe-ab8e-c8a5dcb1f4e9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:40.228519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:40.230272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.230731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.231173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.238278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:40.239936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:40.254063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:40.254946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:40.255821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:40.262296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 436/888] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:40.263788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:40.336634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:40.373006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b9d9f-060b-450c-8a62-4475f0558e9e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:40.408036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be52e5-9747-4395-a679-fd9bb990aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:40.409004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be52e5-9747-4395-a679-fd9bb990aa61 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.409433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be52e5-9747-4395-a679-fd9bb990aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.409844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be52e5-9747-4395-a679-fd9bb990aa61 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.410781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be52e5-9747-4395-a679-fd9bb990aa61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:40.411240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be52e5-9747-4395-a679-fd9bb990aa61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:40.412977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be52e5-9747-4395-a679-fd9bb990aa61 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:40.432340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 453/889] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:40.435502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:40.493252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b960-f355-4171-b414-b746db9fc3b4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.493799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b960-f355-4171-b414-b746db9fc3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.494229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9b960-f355-4171-b414-b746db9fc3b4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.495929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 454/890] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:40.501793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dea95-4475-49f2-afce-000bd304dc4d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.502314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dea95-4475-49f2-afce-000bd304dc4d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.502800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dea95-4475-49f2-afce-000bd304dc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.507306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:40.524024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e37dea95-4475-49f2-afce-000bd304dc4d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:40.525676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e37dea95-4475-49f2-afce-000bd304dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:40.552606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4c95f-a2f8-4824-9699-2257f5648d8c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:40.590282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:40.590870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.591156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.594324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.594324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] RBAC: Adding query filter params (role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=804e3317fa4f460aa7078b94db562934) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:40.594324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:40.594324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:40.601640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 437/891] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:40 2022] GET /identity/v3/role_assignments?user.id=804e3317fa4f460aa7078b94db562934&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:40.616865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 455/892] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:40.639688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:40.769299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a46a2-9f5f-4943-b56e-9f3bba05e61a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:40.796924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:40.808110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711b3a-2616-4058-9403-f7e8098ea672 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.808438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711b3a-2616-4058-9403-f7e8098ea672 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.808753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69711b3a-2616-4058-9403-f7e8098ea672 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.809545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:40.810361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 456/893] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:40.810827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.811393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.811871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.812761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:40.814429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:40.815351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65447e7-f88b-42a9-b3d5-c117883031b5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.815647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65447e7-f88b-42a9-b3d5-c117883031b5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.815923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65447e7-f88b-42a9-b3d5-c117883031b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:40.828261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:40.829351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:40.830204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:40.832950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e65447e7-f88b-42a9-b3d5-c117883031b5 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:40.833367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 438/894] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:40.838151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e65447e7-f88b-42a9-b3d5-c117883031b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:40.839785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:40.893801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:40.920282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 457/895] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:40.936467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65447e7-f88b-42a9-b3d5-c117883031b5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:40.951399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08189e7e-6d4e-40ba-90a2-6d1c2bdda9b1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:40.986696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:40.987362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:40.987646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:40.987915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:40.988657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:40.988960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:40.990326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:40.995985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 439/896] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:41.001482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:41.050978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65447e7-f88b-42a9-b3d5-c117883031b5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:41.067586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:41.096789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:41.097973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.098479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.099243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.100216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:41.103361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:41.116753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:41.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:41.118595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:41.121494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 458/897] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:41.132271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da72ff-e928-45e4-a240-ab3cea65c2da None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:41.132440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:41.166741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:41.167860 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.168139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.168436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.169135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:41.169434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:41.171252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:41.177434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 440/898] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:41.200334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:41.257002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cac2e-c358-4ab5-8e05-fafff3de152c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:41.296283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:41.296978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.297265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.297546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.298281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:41.298591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:41.300061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:41.306154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 459/899] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:41.311902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:41.421413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06348360-2655-4fb5-acb3-9f25a37534bd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:41.438497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:41.457309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b458a5f-4be3-4f65-bd7a-c9863589d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:41.458344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458a5f-4be3-4f65-bd7a-c9863589d33d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.458851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458a5f-4be3-4f65-bd7a-c9863589d33d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.459335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b458a5f-4be3-4f65-bd7a-c9863589d33d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.460359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b458a5f-4be3-4f65-bd7a-c9863589d33d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:41.460904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b458a5f-4be3-4f65-bd7a-c9863589d33d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:41.462483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b458a5f-4be3-4f65-bd7a-c9863589d33d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:41.468989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 441/900] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:41.475233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:41.588381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670580f-e268-416c-9240-8005644a3b21 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:41.607050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:41.610229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ee28-6897-4827-928a-ac304f2bbe77 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.610585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ee28-6897-4827-928a-ac304f2bbe77 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.610801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580ee28-6897-4827-928a-ac304f2bbe77 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.612559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 442/901] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:41.617772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f132-3b0e-44a3-9bd7-e43f81c1e097 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.618284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f132-3b0e-44a3-9bd7-e43f81c1e097 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.618793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f1f132-3b0e-44a3-9bd7-e43f81c1e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.635373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:41.636822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.637126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.637408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.638203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] RBAC: Adding query filter params (interface=public, service_id=c5c45e7895c144cdb2fd80b6323faa12, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:41.638517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:41.638764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-40f1f132-3b0e-44a3-9bd7-e43f81c1e097 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:41.639901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:41.640411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-40f1f132-3b0e-44a3-9bd7-e43f81c1e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:41.648223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 460/902] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:00:41 2022] GET /identity/v3/endpoints?service_id=c5c45e7895c144cdb2fd80b6323faa12&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:41.653336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:41.733574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 443/903] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:41.757491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1f132-3b0e-44a3-9bd7-e43f81c1e097 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:41.791434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd33ab-a7a8-4ca3-8b6e-eb54c6ef76ea None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:41.842927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:41.843933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.844435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.845224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.846729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:41.849150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:41.864122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 461/904] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:41 2022] GET /identity/v3/services => generated 1268 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:00:41.890883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f1f132-3b0e-44a3-9bd7-e43f81c1e097 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:41.905018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:41.930696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:41.931528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:41.931804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:41.932076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:41.932829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:41.934673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:41.947945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:41.949593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:41.950460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 444/905] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jun 16 21:00:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:41.958140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:42.013177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:42.075289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054cae5-a1e8-4074-a962-644e0ac10589 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:42.112291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:42.113281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:42.113792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:42.114287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:42.115195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:42.115707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:42.117299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:42.123252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 462/906] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:42.129267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:42.245968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae947-b0da-4718-996b-eedb5b7450b6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:42.282881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:42.283890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:42.284445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:42.284944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:42.285851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:42.286359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:42.287934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:42.294639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 445/907] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:42.300713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:42.409461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768c349-ca79-4020-a058-87fdb86e344f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:42.419039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:42.447296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d98f7-9a72-4acb-b407-5e05a02d0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:42.447958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d98f7-9a72-4acb-b407-5e05a02d0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:42.448343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d98f7-9a72-4acb-b407-5e05a02d0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:42.449107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d98f7-9a72-4acb-b407-5e05a02d0cf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:42.449896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d98f7-9a72-4acb-b407-5e05a02d0cf4 None admin] RBAC: Adding query filter params (interface=public, service_id=f47bc234f5594f1c9cb4de734aaf170c, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:42.450205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d98f7-9a72-4acb-b407-5e05a02d0cf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:42.451571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d98f7-9a72-4acb-b407-5e05a02d0cf4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:42.458667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 463/908] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:00:42 2022] GET /identity/v3/endpoints?service_id=f47bc234f5594f1c9cb4de734aaf170c&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:42.464104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:42.508044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:42.573970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfc56c-597f-4d44-8abd-fe6c641a516f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:42.611668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b128a39-dbe2-4d3f-bebd-c6f2536817ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:42.612373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128a39-dbe2-4d3f-bebd-c6f2536817ce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:42.612656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128a39-dbe2-4d3f-bebd-c6f2536817ce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:42.612936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b128a39-dbe2-4d3f-bebd-c6f2536817ce None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:42.613614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128a39-dbe2-4d3f-bebd-c6f2536817ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:42.614992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b128a39-dbe2-4d3f-bebd-c6f2536817ce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:42.621288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 446/909] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:42 2022] GET /identity/v3/services => generated 1268 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:00:42.869852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a74e-a450-4a4f-979d-950914080964 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:42.871389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a74e-a450-4a4f-979d-950914080964 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:42.871879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5a74e-a450-4a4f-979d-950914080964 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:42.873810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 464/910] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:42.879303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb657-755c-48c3-9347-365b5cbbf92f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:42.879835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb657-755c-48c3-9347-365b5cbbf92f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:42.880351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fb657-755c-48c3-9347-365b5cbbf92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:42.898610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a22fb657-755c-48c3-9347-365b5cbbf92f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:42.900579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a22fb657-755c-48c3-9347-365b5cbbf92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:42.972592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 447/911] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:42.998162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a74e-a450-4a4f-979d-950914080964 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:43.185909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5a74e-a450-4a4f-979d-950914080964 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:43.248941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3eb8e-2dee-426d-bb74-2459f47350c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:43.250267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3eb8e-2dee-426d-bb74-2459f47350c9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:43.250759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3eb8e-2dee-426d-bb74-2459f47350c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:43.251243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3eb8e-2dee-426d-bb74-2459f47350c9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:43.269914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3eb8e-2dee-426d-bb74-2459f47350c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-c3d3eb8e-2dee-426d-bb74-2459f47350c9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:43.286815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:43.288616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:43.289824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 465/912] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 16 21:00:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:43.301539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fb657-755c-48c3-9347-365b5cbbf92f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:43.338239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:43.395656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20111c-6835-4668-a50a-bb43efa50dca None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:43.395979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20111c-6835-4668-a50a-bb43efa50dca None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:43.396262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20111c-6835-4668-a50a-bb43efa50dca None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:43.398191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 466/913] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:43.403449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb333cf-e74f-4864-9f68-366b09381a3d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:43.403745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb333cf-e74f-4864-9f68-366b09381a3d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:43.404026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb333cf-e74f-4864-9f68-366b09381a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:43.421282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fb657-755c-48c3-9347-365b5cbbf92f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:43.427113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9cb333cf-e74f-4864-9f68-366b09381a3d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:43.428334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9cb333cf-e74f-4864-9f68-366b09381a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:43.459752 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:43.460966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:43.461452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:43.461945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:43.463184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:43.463414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:43.464665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:43.466285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:43.476733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 448/914] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 16 21:00:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:43.488693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:43.522106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 467/915] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:43.545282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb333cf-e74f-4864-9f68-366b09381a3d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:43.596407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:43.609203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e58b64-d900-4923-ad12-f0bcf605ab09 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:43.649651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:43.650738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:43.651264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:43.651797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:43.663335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:43.665086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:43.667729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb333cf-e74f-4864-9f68-366b09381a3d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:43.684345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:43.685290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:43.686199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:43.686199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:43.686199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:43.686199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:43.688424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 449/916] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:43.694479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:43.709127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:43.710244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:43.710797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:43.711289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:43.712289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:43.714551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:43.736465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 468/917] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:43 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:00:43.811448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12673a3a-36b3-4bec-a36f-90c1ee856c52 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:43.857431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:43.858112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:43.858395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:43.858673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:43.859404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:43.859714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:43.861140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:43.875440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 450/918] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:43.881398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:43.909978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.000619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162ad0c-ff01-4beb-a12d-ed392d736d42 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.036309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53809dec-bacb-4c44-aa8d-ae212bd69906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.037137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53809dec-bacb-4c44-aa8d-ae212bd69906 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.037421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53809dec-bacb-4c44-aa8d-ae212bd69906 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.037696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53809dec-bacb-4c44-aa8d-ae212bd69906 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.046002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53809dec-bacb-4c44-aa8d-ae212bd69906 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.047553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53809dec-bacb-4c44-aa8d-ae212bd69906 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-53809dec-bacb-4c44-aa8d-ae212bd69906 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:44.064886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:44.065929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:44.066875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 469/919] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:00:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:44.072423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.075846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.125139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605b1dc-086b-47e9-9889-74f0385832c5 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.125800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605b1dc-086b-47e9-9889-74f0385832c5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.126393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605b1dc-086b-47e9-9889-74f0385832c5 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.128406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 470/920] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:44.133821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8853-8aa6-463f-b8ca-cfd506e5d107 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.134108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8853-8aa6-463f-b8ca-cfd506e5d107 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.134384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad8853-8aa6-463f-b8ca-cfd506e5d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.156469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a6ad8853-8aa6-463f-b8ca-cfd506e5d107 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:44.158147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a6ad8853-8aa6-463f-b8ca-cfd506e5d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:44.184900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919a79b-6792-4ce4-bf60-1069bc487807 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.227190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.228118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.228435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.229033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.230961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:44.231275 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.233218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.244272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 471/921] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:44.258413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 451/922] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:44.264451 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad8853-8aa6-463f-b8ca-cfd506e5d107 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.269211 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.279607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.336542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.372406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad8853-8aa6-463f-b8ca-cfd506e5d107 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.378769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb702f-f708-464c-a004-2eb188757d6f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.409938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.410877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.411161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.411435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.415192 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.416081 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.416388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.416659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.417886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.419438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.423381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.424979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:44.431995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:44.433092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 21:00:44.433946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:44.438700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 452/923] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:44.440037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:44.443363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:44.445380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:44.447480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:44.447480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:44.447480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:44.447480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:44.452399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 472/924] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:44.454032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.523735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.550295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50729d3-3aa4-40f5-8bb6-98b52c36451b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.567102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa89e3c-46fb-4457-9b8e-0512834b5665 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.577529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.589071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.589966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.590261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.590486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.591197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:44.591508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.593029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.603224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 453/925] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:44.604816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.609326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.610180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.610631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.611067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.611959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:44.612453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.614123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.632290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 473/926] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:44.633583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.711554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16ed1a-bd31-4da4-b1ab-df2f719629dc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.747830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff4dc-fe99-47a7-a399-ca9d2b74fc23 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.748779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.749446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.749729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.750004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.750813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:44.751124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.752624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.763253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 454/927] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:44.764709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.777233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.789573 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.790707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.791143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.791604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.800221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.801894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:44.818505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:44.819604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:44.820697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:44.822237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:44.828422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 474/928] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:44.831285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:44.875590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b1a9d3-9b28-4ac7-a3c2-0695330232fe None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.912951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d756bcf-9619-4a72-af83-dc391769cc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:44.913686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d756bcf-9619-4a72-af83-dc391769cc32 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.913969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d756bcf-9619-4a72-af83-dc391769cc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.914243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d756bcf-9619-4a72-af83-dc391769cc32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.915055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d756bcf-9619-4a72-af83-dc391769cc32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:44.917643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d756bcf-9619-4a72-af83-dc391769cc32 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:44.944345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 455/929] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:00:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:00:44.958578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee8a5a-954b-4a3a-8b8a-bdda873b1722 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:44.990406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ad6e-17e1-4dd3-a30c-fa93c1e6ac4f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.990771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ad6e-17e1-4dd3-a30c-fa93c1e6ac4f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.990969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e1ad6e-17e1-4dd3-a30c-fa93c1e6ac4f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:44.992601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 456/930] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:44.998413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbc78-5284-4e95-9819-856b5c84577a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:44.998991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbc78-5284-4e95-9819-856b5c84577a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:44.999488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbc78-5284-4e95-9819-856b5c84577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:45.017597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:45.018328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:45.018614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:45.018906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:45.019434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d8bcbc78-5284-4e95-9819-856b5c84577a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:45.019811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:45.020129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:45.021455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d8bcbc78-5284-4e95-9819-856b5c84577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:45.021730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:45.036033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 475/931] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:45.045647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:45.113579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 457/932] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:45.129292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:45.133963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcbc78-5284-4e95-9819-856b5c84577a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:45.185309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:45.195257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8116f7c-cc7c-4647-8533-a913ac37c1fd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:45.239513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:45.240916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:45.241264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:45.241551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/804e3317fa4f460aa7078b94db562934/roles/f66c1fcfbb16462eaa1c8c84ab5aa0d3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:45.244827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=804e3317fa4f460aa7078b94db562934, role_id=f66c1fcfbb16462eaa1c8c84ab5aa0d3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:45.247411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:45.253262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcbc78-5284-4e95-9819-856b5c84577a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:45.267231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 476/933] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:00:45 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/804e3317fa4f460aa7078b94db562934/roles/f66c1fcfbb16462eaa1c8c84ab5aa0d3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:00:45.298031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:45.298969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:45.299322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:45.299662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:45.300442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:45.301920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:45.316557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:45.317562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:45.318403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 458/934] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Jun 16 21:00:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:45.327951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:45.444148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:45.447996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb518e13-e980-42b0-878f-5b164489dfb6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:45.489709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:45.490385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:45.490672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:45.490953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:45.491661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:45.491971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:45.493449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:45.502549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 477/935] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:45.509004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:45.619542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dee8cc-dce0-4b23-b83e-51689ea0eb46 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:45.621360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:45.659991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a59f2-8a20-437d-9b0f-fa673bd4198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:45.660689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a59f2-8a20-437d-9b0f-fa673bd4198b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:45.661042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a59f2-8a20-437d-9b0f-fa673bd4198b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:45.661323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a59f2-8a20-437d-9b0f-fa673bd4198b None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:45.662029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a59f2-8a20-437d-9b0f-fa673bd4198b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:45.662332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a59f2-8a20-437d-9b0f-fa673bd4198b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:45.663696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a59f2-8a20-437d-9b0f-fa673bd4198b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:45.669842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 459/936] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:45.675219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:45.781757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fe7b8-8258-4cf6-a4b8-f2479a5d9837 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:45.828107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e19c27-9124-4d77-8cbc-02710a3234ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:45.829119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19c27-9124-4d77-8cbc-02710a3234ce None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:45.829577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19c27-9124-4d77-8cbc-02710a3234ce None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:45.830024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e19c27-9124-4d77-8cbc-02710a3234ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:45.830990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e19c27-9124-4d77-8cbc-02710a3234ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:45.832566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e19c27-9124-4d77-8cbc-02710a3234ce None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:45.855351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 478/937] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:00:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:00:46.082441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81d36-7163-4383-a93b-91e7547cfec1 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:46.082818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81d36-7163-4383-a93b-91e7547cfec1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:46.083044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81d36-7163-4383-a93b-91e7547cfec1 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:46.084723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 460/938] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:46.090589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a402af-b5aa-4e9c-8e03-3279946958e8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:46.091053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a402af-b5aa-4e9c-8e03-3279946958e8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:46.091383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a402af-b5aa-4e9c-8e03-3279946958e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:46.109182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f0a402af-b5aa-4e9c-8e03-3279946958e8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:46.110427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f0a402af-b5aa-4e9c-8e03-3279946958e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:46.129392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:46.195498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 479/939] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:46.218700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81d36-7163-4383-a93b-91e7547cfec1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:46.330455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81d36-7163-4383-a93b-91e7547cfec1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:46.365633 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:46.366367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:46.366650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:46.366920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:46.367573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:46.368971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:46.382390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:46.383434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:46.384287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 461/940] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:46.389700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a402af-b5aa-4e9c-8e03-3279946958e8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:46.504015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a402af-b5aa-4e9c-8e03-3279946958e8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:46.541172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:46.541845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:46.542683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:46.542964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:46.543775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:46.544087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:46.545498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:46.550910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 480/941] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:46.556628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:46.588496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:46.671254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d133c-2974-4d7c-8dcd-24ae1230716b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:46.704713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:46.705380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:46.705663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:46.705943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:46.706650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:46.706958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:46.708362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:46.713640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 462/942] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:46.722383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:46.737007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:46.834384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c9091-273f-4a58-8ca7-5d9456ae4011 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:46.870912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4753a-d259-4e75-9f58-d380f21f8859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:46.871653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4753a-d259-4e75-9f58-d380f21f8859 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:46.871941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4753a-d259-4e75-9f58-d380f21f8859 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:46.872244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4753a-d259-4e75-9f58-d380f21f8859 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:46.873039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4753a-d259-4e75-9f58-d380f21f8859 None admin] RBAC: Adding query filter params (interface=public, service_id=963821d72de8449fbc9f97dccb34bfbe, region_id=RegionOne) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:46.873353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4753a-d259-4e75-9f58-d380f21f8859 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:46.874723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4753a-d259-4e75-9f58-d380f21f8859 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:46.880503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 481/943] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:00:46 2022] GET /identity/v3/endpoints?service_id=963821d72de8449fbc9f97dccb34bfbe&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:46.886073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:46.983976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:46.990896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8471-c72f-4d71-b8bf-22433722ca4c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:47.028323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee45d-b8c5-4652-aabc-3e73f4da237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:47.029001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee45d-b8c5-4652-aabc-3e73f4da237c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.029289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee45d-b8c5-4652-aabc-3e73f4da237c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.029566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee45d-b8c5-4652-aabc-3e73f4da237c None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.030255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee45d-b8c5-4652-aabc-3e73f4da237c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:47.031636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee45d-b8c5-4652-aabc-3e73f4da237c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:47.038188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 463/944] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:46 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:00:47.383851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8af2-2167-45ef-acbb-d9624467756c None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.384431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8af2-2167-45ef-acbb-d9624467756c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.384431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e8af2-2167-45ef-acbb-d9624467756c None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.386740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 482/945] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:47.392634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4697d1-f381-438b-8bb4-b59243daa547 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.393217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4697d1-f381-438b-8bb4-b59243daa547 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.393217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4697d1-f381-438b-8bb4-b59243daa547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.410671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0f4697d1-f381-438b-8bb4-b59243daa547 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:47.411857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0f4697d1-f381-438b-8bb4-b59243daa547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:47.484163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 464/946] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:47.504053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e8af2-2167-45ef-acbb-d9624467756c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:47.589563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:47.595822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1451-d4fa-4997-a737-fde080eea43d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.596265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1451-d4fa-4997-a737-fde080eea43d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.596433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1451-d4fa-4997-a737-fde080eea43d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.597789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 465/947] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:47.605708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba99ba1-3b96-4390-843d-771c2859a74d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.605996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba99ba1-3b96-4390-843d-771c2859a74d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.606269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba99ba1-3b96-4390-843d-771c2859a74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.623382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6ba99ba1-3b96-4390-843d-771c2859a74d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:47.628150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6ba99ba1-3b96-4390-843d-771c2859a74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:47.635489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e8af2-2167-45ef-acbb-d9624467756c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:47.673929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:47.675135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.675625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.676103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.677124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:47.678985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:47.680595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING keystone.server.flask.common [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 21:00:47.696196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 466/948] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:47.700503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.sql.core [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 21:00:47.700503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 21:00:47.700503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [parameters: {'id': '53749c421a2d4643a2ef4042ef32d862', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 21:00:47.700503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80416) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53749c421a2d4643a2ef4042ef32d862.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53749c421a2d4643a2ef4042ef32d862. Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 21:00:47.718786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 21:00:47.719661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application yield resource Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application next(self.gen) Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise self.value Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application session.commit() Jun 16 21:00:47.720655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.session.flush() Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application compat.raise_( Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 21:00:47.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 21:00:47.722498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application conn.query(q) Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application result.read() Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 21:00:47.723317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [parameters: {'id': '53749c421a2d4643a2ef4042ef32d862', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:47.724479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:47.725276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 53749c421a2d4643a2ef4042ef32d862. Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.726203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 483/949] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Jun 16 21:00:47 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:47.728844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba99ba1-3b96-4390-843d-771c2859a74d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:47.729079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:47.751656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:47.852430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23c8e2-74d4-4ee1-9f33-f9081a7a2db8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:47.860387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba99ba1-3b96-4390-843d-771c2859a74d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:47.890422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:47.900278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:47.901640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.901877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:47.902367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.902702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:47.902981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:47.903253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.903510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:47.911207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:47.912971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:47.915454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:00:47.924996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:47.925903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:47.926745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 484/950] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 16 21:00:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:47.931414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:47.932559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:47.933773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:47.934299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:47.935670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 467/951] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:47.941291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.046080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:48.059438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95b1cd-7aa2-472e-b428-5722b390fda9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.071553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb619d16-5803-48ca-b5b6-9b003e695034 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.101687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63b35-370a-44e9-97ca-4338e1e4aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.102445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63b35-370a-44e9-97ca-4338e1e4aa09 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.102637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63b35-370a-44e9-97ca-4338e1e4aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.102924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63b35-370a-44e9-97ca-4338e1e4aa09 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.103665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f63b35-370a-44e9-97ca-4338e1e4aa09 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:48.103973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f63b35-370a-44e9-97ca-4338e1e4aa09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.106613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f63b35-370a-44e9-97ca-4338e1e4aa09 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.110309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e4df3-a3f0-4c93-8b6a-fc22bc7caf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.111003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4df3-a3f0-4c93-8b6a-fc22bc7caf91 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.111290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4df3-a3f0-4c93-8b6a-fc22bc7caf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.111571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e4df3-a3f0-4c93-8b6a-fc22bc7caf91 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.112388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4df3-a3f0-4c93-8b6a-fc22bc7caf91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:48.112702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4df3-a3f0-4c93-8b6a-fc22bc7caf91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.114502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e4df3-a3f0-4c93-8b6a-fc22bc7caf91 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.123833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 485/952] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 16 21:00:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:48.125623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628456a-29cb-44d3-a3ef-148332499d62 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.126084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628456a-29cb-44d3-a3ef-148332499d62 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.126535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628456a-29cb-44d3-a3ef-148332499d62 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.127858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 486/953] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:48.128576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628456a-29cb-44d3-a3ef-148332499d62 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.138506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 468/954] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:48.140531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78929bbc-2009-476e-a5e0-70fcff0d9d04 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.140831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78929bbc-2009-476e-a5e0-70fcff0d9d04 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.141187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78929bbc-2009-476e-a5e0-70fcff0d9d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.174825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-78929bbc-2009-476e-a5e0-70fcff0d9d04 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:48.176152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-78929bbc-2009-476e-a5e0-70fcff0d9d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:48.202458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:48.274719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628456a-29cb-44d3-a3ef-148332499d62 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.275442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 469/955] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:48.298306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78929bbc-2009-476e-a5e0-70fcff0d9d04 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.313772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.314587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.314961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.315231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.329420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.331130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:48.356554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:48.357543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:48.358525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:48.358525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:48.358525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:48.358525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:48.361128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 487/956] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:48.366928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.387351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:48.438520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78929bbc-2009-476e-a5e0-70fcff0d9d04 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.482817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.483725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.484190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.484542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.485274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.486709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.498352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9d25-c256-4242-9f85-6b13ab73dac1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:48.500525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:48.501801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:48.502866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:48.504432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 470/957] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:48.505411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:48.510438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.546173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.547886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.548384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.548842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.549782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:48.550501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.552967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.575198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 488/958] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:48.575855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.640882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa069d8-ecc8-4629-9b23-ede07d6b5675 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.678608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:48.684890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.685506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.686089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.686824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.688088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:48.688791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.689915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.699338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77635f3-ef03-477f-ab44-65be680143dd None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.700500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 471/959] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:48.701389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.748070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.748936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.749223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.749544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.757697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.759151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:48.776193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:48.777275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 21:00:48.778239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:48.782335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 489/960] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:48.783214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:48.816424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:48.834847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41c17-f9f9-4f4a-b3a6-8979997d270d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.875211 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.875873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.876154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.876513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.877222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:48.877579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.879104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.889740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 472/961] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:48.919418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b241535-b824-46e6-a00b-99bb9faac778 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:48.957933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d51a18-70c7-4c41-a4b3-e0137847f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:48.958544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51a18-70c7-4c41-a4b3-e0137847f8dd None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:48.958878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51a18-70c7-4c41-a4b3-e0137847f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:48.959159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d51a18-70c7-4c41-a4b3-e0137847f8dd None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:48.960070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51a18-70c7-4c41-a4b3-e0137847f8dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:48.960419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51a18-70c7-4c41-a4b3-e0137847f8dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:48.961924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d51a18-70c7-4c41-a4b3-e0137847f8dd None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:48.983538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 490/962] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:48.989538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:49.055785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:49.108588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb484b-ede2-491a-a02f-42a6140978e6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:49.148818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:49.149913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.150459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.151011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.226945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:49.228822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:49.294736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:49.328750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae61cf-3392-4d09-8ce5-d5af78bfb14e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.329084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae61cf-3392-4d09-8ce5-d5af78bfb14e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.329468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae61cf-3392-4d09-8ce5-d5af78bfb14e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.331889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 491/963] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:49.338471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcc253-c978-4872-b59c-2a646afa6df4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.338758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcc253-c978-4872-b59c-2a646afa6df4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.339079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcc253-c978-4872-b59c-2a646afa6df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.344258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 473/964] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:00:48 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:00:49.349757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:49.361391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-34fcc253-c978-4872-b59c-2a646afa6df4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:49.363027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-34fcc253-c978-4872-b59c-2a646afa6df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:49.447899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 492/965] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:49.473694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcc253-c978-4872-b59c-2a646afa6df4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:49.483491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bceef5-dafa-4f50-920e-2ffca08ca8f6 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:49.491351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:49.533377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:49.534186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.534467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.534742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.548089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:49.550169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:00:49.569131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:49.570072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:49.570954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:00:49.570954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:00:49.570954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:00:49.570954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:49.570954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 474/966] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:49.576869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:49.587430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fcc253-c978-4872-b59c-2a646afa6df4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:49.598199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:49.628081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:49.629282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.629768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.630243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.631112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:49.632716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:49.645807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:49.646830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:49.647672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:49.650193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 493/967] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:49.656571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:49.712709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c09a6-a30a-43b2-b491-71b5c7d7309b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:49.743259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:49.764645 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:49.765461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.765746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.766023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.766773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:49.767365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:49.769683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:49.771405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adf609-f632-4c3b-97f2-9c008939166a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:49.788325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 475/968] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:49.794099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:49.819233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:49.820023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.820339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.820618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.821709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:49.822016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:49.824054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:49.832271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 494/969] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:49.837066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:49.895393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:49.938753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13806de-b7c3-4f30-a4a4-1d33dfb858b5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:49.947197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a8a9f2-74b2-4424-beb4-75282c82f911 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:49.984567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:49.985458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.985745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.986022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.986350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:49.987240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:49.987811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:49.988345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:49.989413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:49.989944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:49.991508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:49.993339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:49.996063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:49.998886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 495/970] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:50.004235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:50.008997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:00:50.021765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:50.022829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:00:50.023728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:50.028328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 476/971] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:50.030510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:50.126619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff981d-749f-4805-ab36-7a9454b0990c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:50.170308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:50.171338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df0f48-2fbf-4261-a9a2-69e4634c82e4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:50.171600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:50.172104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:50.172607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:50.174728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:50.176423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:50.204472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 496/972] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:00:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:50.209345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:50.224765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffeb060-64fa-48e4-bdcf-da0dc9063417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:50.225909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb060-64fa-48e4-bdcf-da0dc9063417 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:50.226484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb060-64fa-48e4-bdcf-da0dc9063417 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:50.226989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffeb060-64fa-48e4-bdcf-da0dc9063417 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:50.228092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb060-64fa-48e4-bdcf-da0dc9063417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:50.228692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb060-64fa-48e4-bdcf-da0dc9063417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:50.231212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffeb060-64fa-48e4-bdcf-da0dc9063417 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:50.246565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 477/973] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:00:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:50.252193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:50.328320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:50.378827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79010890-862f-4551-bc67-4ea5a24d49b7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:50.419754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63623c99-dcb7-4f5c-b5f5-e26650b47d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:50.420471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623c99-dcb7-4f5c-b5f5-e26650b47d59 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:50.420755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623c99-dcb7-4f5c-b5f5-e26650b47d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:50.421031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63623c99-dcb7-4f5c-b5f5-e26650b47d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:50.421881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63623c99-dcb7-4f5c-b5f5-e26650b47d59 None admin] RBAC: Adding query filter params (role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=804e3317fa4f460aa7078b94db562934) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:50.422194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63623c99-dcb7-4f5c-b5f5-e26650b47d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:50.423659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63623c99-dcb7-4f5c-b5f5-e26650b47d59 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:50.430923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 497/974] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:00:50 2022] GET /identity/v3/role_assignments?user.id=804e3317fa4f460aa7078b94db562934&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:50.462684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724590d7-1c9c-40fa-a5cc-ac1d3020ddbd None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:50.463322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724590d7-1c9c-40fa-a5cc-ac1d3020ddbd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:50.463808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724590d7-1c9c-40fa-a5cc-ac1d3020ddbd None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:50.466472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 478/975] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:50.471994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176de4b-b191-47ae-978d-198cd70cada2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:50.472368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176de4b-b191-47ae-978d-198cd70cada2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:50.472588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176de4b-b191-47ae-978d-198cd70cada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:50.491522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3176de4b-b191-47ae-978d-198cd70cada2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:50.492775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3176de4b-b191-47ae-978d-198cd70cada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:50.578321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 498/976] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:50.604154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724590d7-1c9c-40fa-a5cc-ac1d3020ddbd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:50.721849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724590d7-1c9c-40fa-a5cc-ac1d3020ddbd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:50.758586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:50.759687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:50.760259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:50.760792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:50.761761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:50.763431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:50.765009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING keystone.server.flask.common [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 21:00:50.779480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.sql.core [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 21:00:50.779480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 21:00:50.779480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [parameters: {'user_id': '1db53ede66ee4d6bba804bd5561baffb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 21:00:50.779480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80415) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application conn.query(q) Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result.read() Jun 16 21:00:50.787926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 21:00:50.788922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application next(self.gen) Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application yield resource Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application next(self.gen) Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise self.value Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application session.commit() Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 21:00:50.789914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.session.flush() Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application compat.raise_( Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 21:00:50.790816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 21:00:50.792992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application conn.query(q) Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application result.read() Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 21:00:50.793868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [parameters: {'user_id': '1db53ede66ee4d6bba804bd5561baffb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:50.794861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 21:00:50.795832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 21:00:50.796794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 21:00:50.796794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 21:00:50.796794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 21:00:50.796794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 21:00:50.796794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 21:00:50.796794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:50.796794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 479/977] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Jun 16 21:00:50 2022] POST /identity/v3/users => generated 160 bytes in 191 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:50.800018 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176de4b-b191-47ae-978d-198cd70cada2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:50.862122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:50.908444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176de4b-b191-47ae-978d-198cd70cada2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:50.944163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9125b8a-5cd2-4ef1-93df-b1c214a09712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:50.944982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9125b8a-5cd2-4ef1-93df-b1c214a09712 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:50.945314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9125b8a-5cd2-4ef1-93df-b1c214a09712 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:50.945590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9125b8a-5cd2-4ef1-93df-b1c214a09712 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:50.953796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9125b8a-5cd2-4ef1-93df-b1c214a09712 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:50.955293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9125b8a-5cd2-4ef1-93df-b1c214a09712 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e9125b8a-5cd2-4ef1-93df-b1c214a09712 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:00:50.970125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:50.972465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:50.975044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 499/978] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:00:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:50.980587 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:51.035235 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:51.088221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e937fb5-92e1-48e5-8b98-798005ab5298 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:51.125272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709bc00-6096-4b61-aa17-9e23c6416cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:51.125877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bc00-6096-4b61-aa17-9e23c6416cfc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:51.126154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bc00-6096-4b61-aa17-9e23c6416cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:51.126423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709bc00-6096-4b61-aa17-9e23c6416cfc None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:51.127240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709bc00-6096-4b61-aa17-9e23c6416cfc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:51.127549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709bc00-6096-4b61-aa17-9e23c6416cfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:51.129268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709bc00-6096-4b61-aa17-9e23c6416cfc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:51.172887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 480/979] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Jun 16 21:00:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:51.203041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21e66-f169-4360-8f3b-b0ce66609728 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:51.203041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21e66-f169-4360-8f3b-b0ce66609728 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:51.203041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f21e66-f169-4360-8f3b-b0ce66609728 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:51.203957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 500/980] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:51.210155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f950a68-6590-4399-a348-851582e96a5b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:51.210787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f950a68-6590-4399-a348-851582e96a5b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:51.211272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f950a68-6590-4399-a348-851582e96a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:51.230754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5f950a68-6590-4399-a348-851582e96a5b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:51.232782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5f950a68-6590-4399-a348-851582e96a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:51.311957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 481/981] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:51.336456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21e66-f169-4360-8f3b-b0ce66609728 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:51.450365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f21e66-f169-4360-8f3b-b0ce66609728 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:51.465976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:51.488650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a78299-2268-4679-bbc9-4c89ce2f369b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:51.489587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78299-2268-4679-bbc9-4c89ce2f369b None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:51.489868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78299-2268-4679-bbc9-4c89ce2f369b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:51.490141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a78299-2268-4679-bbc9-4c89ce2f369b None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:51.490954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a78299-2268-4679-bbc9-4c89ce2f369b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:51.492337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a78299-2268-4679-bbc9-4c89ce2f369b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:51.509980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 501/982] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:51 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:52.489717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db165a-b64f-4005-9303-522e00ea7d66 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:52.490242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db165a-b64f-4005-9303-522e00ea7d66 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:52.490354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db165a-b64f-4005-9303-522e00ea7d66 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:52.491690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 482/983] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:52.496996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954085-1008-4837-aaa2-9324baccbd0a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:52.497437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954085-1008-4837-aaa2-9324baccbd0a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:52.497617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da954085-1008-4837-aaa2-9324baccbd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:52.515081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-da954085-1008-4837-aaa2-9324baccbd0a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:52.516306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-da954085-1008-4837-aaa2-9324baccbd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:52.602041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 502/984] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:52.617457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db165a-b64f-4005-9303-522e00ea7d66 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:52.665468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:52.706026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5213-47ec-4486-acce-582b5141edac None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:52.706316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5213-47ec-4486-acce-582b5141edac None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:52.706594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e5213-47ec-4486-acce-582b5141edac None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:52.708104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 503/985] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:52.712826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141da2-871b-4c85-ba44-ecf43a58b77d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:52.713113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141da2-871b-4c85-ba44-ecf43a58b77d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:52.713398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141da2-871b-4c85-ba44-ecf43a58b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:52.730422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3f141da2-871b-4c85-ba44-ecf43a58b77d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:52.731698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3f141da2-871b-4c85-ba44-ecf43a58b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:52.731869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db165a-b64f-4005-9303-522e00ea7d66 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:52.771025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:52.771744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:52.772022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:52.772323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:52.772970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:52.774336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:52.787312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:52.788426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:00:52.789421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 483/986] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:52.795018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:52.805055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 504/987] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:52.827151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f141da2-871b-4c85-ba44-ecf43a58b77d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:52.860267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:52.899997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dda90-7a89-4917-b63b-2706fc436e8a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:52.902358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:52.933934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f141da2-871b-4c85-ba44-ecf43a58b77d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:52.936336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:52.936998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:52.937275 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:52.937548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:52.938243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:52.938547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:52.939909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:52.944850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 484/988] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:52.950794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:52.972824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:52.973609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:52.973888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:52.974158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:52.975054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:52.976437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:52.988006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:52.989016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:52.989894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 505/989] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jun 16 21:00:52 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:52.994897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:53.061683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c099c-a920-404c-8f7c-f0e7081dbe96 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:53.092118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:53.097321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:53.097989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.098267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.098538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.099505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:53.099810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:53.100546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4dcc0-a48f-4362-b4b7-178cd85a6bf5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:53.101205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:53.111861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 485/990] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:53.112742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:53.137395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:53.138217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.138752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.138752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.139459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:53.139764 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:53.141343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:53.151150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:53.152989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 506/991] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:53.154357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:53.226986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7cc00-9df8-4213-87b4-2dc005d9b9a5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:53.260231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73193e-84b5-4481-8dd2-44e147319ab2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:53.268615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:53.269577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.270054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.270468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.271415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] RBAC: Adding query filter params (interface=admin, service_id=963821d72de8449fbc9f97dccb34bfbe, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:53.271861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:53.273417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:53.282086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 486/992] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Jun 16 21:00:53 2022] GET /identity/v3/endpoints?service_id=963821d72de8449fbc9f97dccb34bfbe&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:53.287665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:53.295481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f86ef-5a96-43a3-81ae-7588bbb31f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:53.296224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f86ef-5a96-43a3-81ae-7588bbb31f15 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.296509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f86ef-5a96-43a3-81ae-7588bbb31f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.296782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f86ef-5a96-43a3-81ae-7588bbb31f15 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.297486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f86ef-5a96-43a3-81ae-7588bbb31f15 None admin] RBAC: Adding query filter params (type=image) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:53.297794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f86ef-5a96-43a3-81ae-7588bbb31f15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:53.299337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f86ef-5a96-43a3-81ae-7588bbb31f15 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:53.304331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 507/993] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:53.401178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:53.409757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbdc2b-f38d-4874-8ea3-f70c677be5d5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:53.445717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4c7ce-768c-4bec-97a2-52e9ffde735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:53.446397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c7ce-768c-4bec-97a2-52e9ffde735f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.446676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c7ce-768c-4bec-97a2-52e9ffde735f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.446950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4c7ce-768c-4bec-97a2-52e9ffde735f None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.447639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4c7ce-768c-4bec-97a2-52e9ffde735f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:53.449237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4c7ce-768c-4bec-97a2-52e9ffde735f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:53.464462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 487/994] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:53 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:00:53.681755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d68aa6-d40c-4279-9e7e-d4cbe4389224 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.682261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d68aa6-d40c-4279-9e7e-d4cbe4389224 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.682261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d68aa6-d40c-4279-9e7e-d4cbe4389224 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.684381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 508/995] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:53.689556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d2258-7bf5-49bc-a596-8f3db8ce6823 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.689980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d2258-7bf5-49bc-a596-8f3db8ce6823 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.690149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d2258-7bf5-49bc-a596-8f3db8ce6823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.707556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c26d2258-7bf5-49bc-a596-8f3db8ce6823 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:53.708762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c26d2258-7bf5-49bc-a596-8f3db8ce6823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:53.778047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 488/996] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:53.801799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d68aa6-d40c-4279-9e7e-d4cbe4389224 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:53.827761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:53.906516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d68aa6-d40c-4279-9e7e-d4cbe4389224 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:53.941476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:53.942202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:53.942487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:53.942762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:53.943413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:53.944804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:53.957753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:53.958773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:53.959615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:53.963787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 509/997] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:53.965147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d2258-7bf5-49bc-a596-8f3db8ce6823 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:54.056150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:54.069469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d2258-7bf5-49bc-a596-8f3db8ce6823 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:54.104710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:54.105457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:54.105740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:54.106015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:54.106721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:54.107027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:54.108421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:54.117779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 489/998] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:54.119323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:54.208897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:54.224800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475603e2-9357-4bca-8f8c-e4ab47cc0f77 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:54.258244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:54.258918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:54.259204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:54.259485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:54.260212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:54.260529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:54.262544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:54.267627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 510/999] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:54.273353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:54.372953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4b869-d46a-4e11-8de2-609d156de26e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:54.406293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c5cc-2bdd-46ec-b773-7a964142ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:54.406950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c5cc-2bdd-46ec-b773-7a964142ea23 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:54.407240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c5cc-2bdd-46ec-b773-7a964142ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:54.407516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c5cc-2bdd-46ec-b773-7a964142ea23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:54.408330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c5cc-2bdd-46ec-b773-7a964142ea23 None admin] RBAC: Adding query filter params (interface=public, service_id=5ed5ca4a9edb4ba98847137e7126a35a, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:54.408647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c5cc-2bdd-46ec-b773-7a964142ea23 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:54.410012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34c5cc-2bdd-46ec-b773-7a964142ea23 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:54.420495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 490/1000] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:00:54 2022] GET /identity/v3/endpoints?service_id=5ed5ca4a9edb4ba98847137e7126a35a&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:54.421406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:54.524686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781c2e0-b8e9-427a-b717-876df3b713d5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:54.558221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0e8c0-e1b7-4578-ac08-0b1e7d25a67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:54.558941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e8c0-e1b7-4578-ac08-0b1e7d25a67a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:54.559225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e8c0-e1b7-4578-ac08-0b1e7d25a67a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:54.559504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0e8c0-e1b7-4578-ac08-0b1e7d25a67a None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:54.560209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0e8c0-e1b7-4578-ac08-0b1e7d25a67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:54.561613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0e8c0-e1b7-4578-ac08-0b1e7d25a67a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:54.572458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 511/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:54 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:00:55.512941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54438-c46b-4be3-a174-fdb933075945 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:55.513508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54438-c46b-4be3-a174-fdb933075945 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:55.513508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a54438-c46b-4be3-a174-fdb933075945 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:55.515013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 491/1002] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:55.520082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a145-ac72-498d-a146-1d1df7d6dc70 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:55.520503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a145-ac72-498d-a146-1d1df7d6dc70 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:55.520664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1a145-ac72-498d-a146-1d1df7d6dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:55.537247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e9d1a145-ac72-498d-a146-1d1df7d6dc70 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:55.538409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e9d1a145-ac72-498d-a146-1d1df7d6dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:55.548040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:55.618258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 512/1003] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:55.641271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54438-c46b-4be3-a174-fdb933075945 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:55.649802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02821-278d-40cd-b06b-4b31b92e45ec None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:55.650197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02821-278d-40cd-b06b-4b31b92e45ec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:55.650479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b02821-278d-40cd-b06b-4b31b92e45ec None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:55.653138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 513/1004] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:00:55.658933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc705-38c8-47a8-afa7-91e5420c8690 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:55.659317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc705-38c8-47a8-afa7-91e5420c8690 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:55.659608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ddc705-38c8-47a8-afa7-91e5420c8690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:55.661204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:55.679253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-07ddc705-38c8-47a8-afa7-91e5420c8690 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:55.680599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-07ddc705-38c8-47a8-afa7-91e5420c8690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:55.756547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a54438-c46b-4be3-a174-fdb933075945 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:55.760387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 514/1005] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:55.780652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddc705-38c8-47a8-afa7-91e5420c8690 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:55.795994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:55.796692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:55.796977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:55.797252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:55.797978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:55.799358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:55.820641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 492/1006] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:55 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:55.862360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:55.892456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ddc705-38c8-47a8-afa7-91e5420c8690 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:55.935582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:55.936445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:55.936732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:55.937011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:55.937703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:55.939105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:55.952728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:55.953827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 21:00:55.954705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:55.959126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 515/1007] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Jun 16 21:00:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:00:55.960461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:56.043997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:56.069410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4cdc36-399d-4835-9f10-047a26fee303 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:56.103373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:56.104046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:56.104365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:56.105341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:56.106244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:56.106557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:56.107931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:56.117549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 493/1008] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:56.119119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:56.221000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be674c9-86db-4bca-baa1-fce7573a09da None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:56.255318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae17ee0-929c-4224-aada-a87a933eec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:56.256068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17ee0-929c-4224-aada-a87a933eec21 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:56.256438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17ee0-929c-4224-aada-a87a933eec21 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:56.256774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17ee0-929c-4224-aada-a87a933eec21 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:56.257541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae17ee0-929c-4224-aada-a87a933eec21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:56.257914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae17ee0-929c-4224-aada-a87a933eec21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:56.259338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae17ee0-929c-4224-aada-a87a933eec21 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:56.260695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:56.265901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 516/1009] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Jun 16 21:00:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:56.272068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:56.376790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1a0ae-29bc-418b-a947-924b1c82124a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:56.410320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18bef-23b5-4255-9815-098d27a3cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:56.410985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18bef-23b5-4255-9815-098d27a3cbf5 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:56.411270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18bef-23b5-4255-9815-098d27a3cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:56.411550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18bef-23b5-4255-9815-098d27a3cbf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:56.412487 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a18bef-23b5-4255-9815-098d27a3cbf5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:56.413855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a18bef-23b5-4255-9815-098d27a3cbf5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:56.425984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:56.440260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 494/1010] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:00:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:00:56.757703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258070f-d28f-4741-a3ff-466cee5aff28 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:56.758222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258070f-d28f-4741-a3ff-466cee5aff28 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:56.758222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258070f-d28f-4741-a3ff-466cee5aff28 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:56.759691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 517/1011] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:56.765435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbc4f9-2436-489e-acda-56c1c15d7f82 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:56.765863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbc4f9-2436-489e-acda-56c1c15d7f82 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:56.766053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdbc4f9-2436-489e-acda-56c1c15d7f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:56.783679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-acdbc4f9-2436-489e-acda-56c1c15d7f82 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:56.784895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-acdbc4f9-2436-489e-acda-56c1c15d7f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:56.860094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 495/1012] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:56 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:56.882896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258070f-d28f-4741-a3ff-466cee5aff28 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:56.988937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258070f-d28f-4741-a3ff-466cee5aff28 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:57.023299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:57.024022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:57.024342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:57.024621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:57.025274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:57.028299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:57.040136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:57.041245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:57.043015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 518/1013] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:00:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:57.048236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbc4f9-2436-489e-acda-56c1c15d7f82 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:57.160547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdbc4f9-2436-489e-acda-56c1c15d7f82 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:57.186751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:57.196800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:57.197471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:57.197756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:57.198033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:57.199383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:57.199688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:57.201093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:57.206140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 496/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:57.211602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:57.275509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:57.316687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e25891-da75-4942-9e2d-2534f8480fe9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:57.350449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0735194-4be6-4113-9123-ea19f0b4ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:57.351112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735194-4be6-4113-9123-ea19f0b4ed48 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:57.351394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735194-4be6-4113-9123-ea19f0b4ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:57.351667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0735194-4be6-4113-9123-ea19f0b4ed48 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:57.352393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0735194-4be6-4113-9123-ea19f0b4ed48 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:57.352698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0735194-4be6-4113-9123-ea19f0b4ed48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:57.354060 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0735194-4be6-4113-9123-ea19f0b4ed48 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:57.363808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 519/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Jun 16 21:00:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:57.365057 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:57.465202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3f4f4-d9a8-4e89-854c-6e6d9869bc3a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:57.508362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcfb83-670f-4d1b-a0bb-eb6d4d9cf049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:57.509024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcfb83-670f-4d1b-a0bb-eb6d4d9cf049 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:57.509305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcfb83-670f-4d1b-a0bb-eb6d4d9cf049 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:57.509578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcfb83-670f-4d1b-a0bb-eb6d4d9cf049 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:57.510327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcfb83-670f-4d1b-a0bb-eb6d4d9cf049 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:57.512414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbcfb83-670f-4d1b-a0bb-eb6d4d9cf049 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:57.540293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 497/1016] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:00:57 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:57.985256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6a04a-d404-4eae-876e-e26461ba575c None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:57.985789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6a04a-d404-4eae-876e-e26461ba575c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:57.985789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6a04a-d404-4eae-876e-e26461ba575c None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:57.987327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 520/1017] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:57.992378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241ca33-5943-47df-b841-c25774f38110 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:57.992801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241ca33-5943-47df-b841-c25774f38110 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:57.992990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241ca33-5943-47df-b841-c25774f38110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.010143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a241ca33-5943-47df-b841-c25774f38110 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:58.011915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a241ca33-5943-47df-b841-c25774f38110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:58.053666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:58.087477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 498/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:58.110931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6a04a-d404-4eae-876e-e26461ba575c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:58.214575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6a04a-d404-4eae-876e-e26461ba575c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:58.239562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:58.249837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:58.250635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.250918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.251190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.251838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:58.253243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:00:58.265781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:00:58.266873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:00:58.267717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:00:58.275067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 521/1019] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jun 16 21:00:58 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:00:58.275201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241ca33-5943-47df-b841-c25774f38110 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:58.374268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241ca33-5943-47df-b841-c25774f38110 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:58.407391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:58.408059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.408371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.408646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.409350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] RBAC: Adding query filter params (name=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:58.409655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:58.411019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:58.421144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 499/1020] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:58.422239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:58.523616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15d24d-f9b8-4979-bba4-c34efbabf9a8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:58.558033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6279db-8f4d-4c8d-b5ee-869d9c3ed8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:58.558849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6279db-8f4d-4c8d-b5ee-869d9c3ed8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.559137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6279db-8f4d-4c8d-b5ee-869d9c3ed8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.559420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6279db-8f4d-4c8d-b5ee-869d9c3ed8c3 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.560162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6279db-8f4d-4c8d-b5ee-869d9c3ed8c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:58.560513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6279db-8f4d-4c8d-b5ee-869d9c3ed8c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:58.561937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6279db-8f4d-4c8d-b5ee-869d9c3ed8c3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:58.572629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 522/1021] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:58.574525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:58.620018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:58.624640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb33e-c0f3-4700-8e52-3cb22293e4e6 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.624939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb33e-c0f3-4700-8e52-3cb22293e4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.625218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb33e-c0f3-4700-8e52-3cb22293e4e6 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.626605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 523/1022] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:58.631546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad83a7-0ba0-4a91-b70a-0569dfa3a6f2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.631839 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad83a7-0ba0-4a91-b70a-0569dfa3a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.632123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad83a7-0ba0-4a91-b70a-0569dfa3a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.649829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c9ad83a7-0ba0-4a91-b70a-0569dfa3a6f2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:58.651019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c9ad83a7-0ba0-4a91-b70a-0569dfa3a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:58.690495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d54a8-eb92-4127-81e4-a83a68122651 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:58.706291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:58.728621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:58.729288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.729661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.729946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.732230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] RBAC: Adding query filter params (interface=public, service_id=a38030cdd224409c9a9ab2cb08bc1968, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:00:58.732368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 524/1023] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:00:58.732471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:58.732567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:58.740334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 500/1024] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:00:58 2022] GET /identity/v3/endpoints?service_id=a38030cdd224409c9a9ab2cb08bc1968&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:00:58.746567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad83a7-0ba0-4a91-b70a-0569dfa3a6f2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:58.755716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:58.863861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:58.865936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad83a7-0ba0-4a91-b70a-0569dfa3a6f2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:58.867729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd630be-3928-4e7b-9242-008310d3f3ca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:58.902873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d9e5d-0c37-46d3-9074-836885ac116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:58.903538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9e5d-0c37-46d3-9074-836885ac116a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.903825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9e5d-0c37-46d3-9074-836885ac116a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.904101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d9e5d-0c37-46d3-9074-836885ac116a None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.904817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9e5d-0c37-46d3-9074-836885ac116a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:58.905584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:58.906193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d9e5d-0c37-46d3-9074-836885ac116a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:58.906827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:58.907317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:58.907789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:58.909138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:58.910705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:58.912798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 501/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:00:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:00:58.919377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:58.920419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 525/1026] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:00:58 2022] GET /identity/v3/services => generated 1957 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:00:59.046041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293afe34-e0ee-43c4-816b-c538e8d286bb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:00:59.085840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacc906c-a913-45da-902c-88f943f87666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:00:59.086506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc906c-a913-45da-902c-88f943f87666 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:59.086788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc906c-a913-45da-902c-88f943f87666 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:59.087062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc906c-a913-45da-902c-88f943f87666 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:59.087767 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc906c-a913-45da-902c-88f943f87666 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:00:59.089741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacc906c-a913-45da-902c-88f943f87666 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:00:59.119867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 502/1027] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:00:58 2022] POST /identity/v3/projects => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:00:59.770319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ebf4-028a-4fbf-bda4-a493b60cdf7b None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:59.770838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ebf4-028a-4fbf-bda4-a493b60cdf7b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:59.770916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ebf4-028a-4fbf-bda4-a493b60cdf7b None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:59.772411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 526/1028] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:00:59.777923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aef483-82bb-4221-b780-ba5c9116d08f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:00:59.778215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aef483-82bb-4221-b780-ba5c9116d08f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:00:59.778495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aef483-82bb-4221-b780-ba5c9116d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:00:59.795068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a4aef483-82bb-4221-b780-ba5c9116d08f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:00:59.796291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a4aef483-82bb-4221-b780-ba5c9116d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:00:59.820057 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:00:59.877450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 503/1029] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:00:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:00:59.901166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ebf4-028a-4fbf-bda4-a493b60cdf7b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:00:59.952962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:00.006107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ebf4-028a-4fbf-bda4-a493b60cdf7b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:00.043575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:00.044463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:00.044751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:00.045029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:00.055218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:00.063750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:00.064731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:00.065581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 527/1030] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 16 21:00:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:00.070865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aef483-82bb-4221-b780-ba5c9116d08f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:00.171439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aef483-82bb-4221-b780-ba5c9116d08f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:00.205580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:00.206255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:00.206541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:00.206821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:00.207567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:00.207876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:00.209277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:00.222318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 504/1031] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 16 21:01:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:00.223457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:00.327996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798da82e-393d-41f4-9909-b12353a817a4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:00.337017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:00.364299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:00.365101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:00.365387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:00.365667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:00.376375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:00.377832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:00.394706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:00.395601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:00.396554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:01:00.396554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:00.396554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:00.396554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:00.396554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 528/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:00.403167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:00.419244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:00.505985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c877-3ba3-4e4c-a7e9-75524ba2a802 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:00.539448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:00.540114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:00.540422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:00.540701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:00.541449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:00.541777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:00.543255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:00.555348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 505/1033] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:00.561539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:00.673311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81909676-31bb-40d0-b23a-52628de0be58 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:00.707137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:00.707933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:00.708240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:00.708519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:00.716209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:00.717651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:01:00.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:00.733438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:01:00.734468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:00.735652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 529/1034] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:01:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:00.739663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:00.816968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:00.852087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53326a-eea0-43d2-b95a-a574ca5512ad None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:00.887998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da4ffd-ab01-489a-b489-934984c8d84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:00.888704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4ffd-ab01-489a-b489-934984c8d84c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:00.888989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4ffd-ab01-489a-b489-934984c8d84c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:00.889265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da4ffd-ab01-489a-b489-934984c8d84c None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:00.890109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4ffd-ab01-489a-b489-934984c8d84c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:00.890423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4ffd-ab01-489a-b489-934984c8d84c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:00.891850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da4ffd-ab01-489a-b489-934984c8d84c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:00.914437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 506/1035] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:01:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:00.915862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:00.940099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.023837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60babd87-e3c4-4213-9459-c611dbf75851 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.058682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.059332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.059614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.059888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.061954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27439f7-9d8f-48dd-b575-c0210e337283 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.062243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27439f7-9d8f-48dd-b575-c0210e337283 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.062521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27439f7-9d8f-48dd-b575-c0210e337283 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.063898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 507/1036] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:01.068896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4f813-7b5d-463d-bab8-48d98313de7c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.069114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4f813-7b5d-463d-bab8-48d98313de7c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.069393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4f813-7b5d-463d-bab8-48d98313de7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.086088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e3a4f813-7b5d-463d-bab8-48d98313de7c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:01.087256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3a4f813-7b5d-463d-bab8-48d98313de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:01.134614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.136717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.158189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.176513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 508/1037] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:01:01.190985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4f813-7b5d-463d-bab8-48d98313de7c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.250577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 530/1038] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 21:01:01.256373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.258087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.303536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4f813-7b5d-463d-bab8-48d98313de7c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.338755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50164f47-4a81-4561-ae9c-4f2ada725a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.339535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164f47-4a81-4561-ae9c-4f2ada725a61 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.339821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164f47-4a81-4561-ae9c-4f2ada725a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.340097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50164f47-4a81-4561-ae9c-4f2ada725a61 None admin] PATH_INFO: `/v3/services/image` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.340793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50164f47-4a81-4561-ae9c-4f2ada725a61 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.342163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50164f47-4a81-4561-ae9c-4f2ada725a61 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-50164f47-4a81-4561-ae9c-4f2ada725a61 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:01.354286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:01.356025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:01.356905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 509/1039] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Jun 16 21:01:01 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:01.357889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447050ad-ad94-4c9d-af1a-96b2ddb197b7 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.357889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447050ad-ad94-4c9d-af1a-96b2ddb197b7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.357889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447050ad-ad94-4c9d-af1a-96b2ddb197b7 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.359259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 510/1040] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:01.361809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447050ad-ad94-4c9d-af1a-96b2ddb197b7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.368109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1ae7-c034-478e-8b66-4fc783930f30 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.389946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.405581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b0247-ee38-46e3-8112-13983c70e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.406387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0247-ee38-46e3-8112-13983c70e04f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.406675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0247-ee38-46e3-8112-13983c70e04f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.406949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b0247-ee38-46e3-8112-13983c70e04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.417176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b0247-ee38-46e3-8112-13983c70e04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.418623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b0247-ee38-46e3-8112-13983c70e04f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-897b0247-ee38-46e3-8112-13983c70e04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:01.435954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:01.436901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:01.437792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:01:01.437792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:01.437792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:01.437792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:01.437792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 531/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:01.438467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53752fa-0386-4dad-aef8-a4cb6d8281b4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.438660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53752fa-0386-4dad-aef8-a4cb6d8281b4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.438938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53752fa-0386-4dad-aef8-a4cb6d8281b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.455255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a53752fa-0386-4dad-aef8-a4cb6d8281b4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:01.456473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a53752fa-0386-4dad-aef8-a4cb6d8281b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:01.467031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447050ad-ad94-4c9d-af1a-96b2ddb197b7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.489404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.500687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.501342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.501618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.501887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.502584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] RBAC: Adding query filter params (name=image) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:01.502889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.504268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.509191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 511/1042] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:01.514438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.524515 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 532/1043] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:01.525364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53752fa-0386-4dad-aef8-a4cb6d8281b4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.623029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf559f-b842-4482-ac6f-b8c3a6c483fc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.626876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53752fa-0386-4dad-aef8-a4cb6d8281b4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.628437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.658513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.659169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.659448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.659718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.660452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:01.660766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.662123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.662245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.662846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.663132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.663450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.664158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] RBAC: Adding query filter params (type=image) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:01.664509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.665862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.671329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 533/1044] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:01.672114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.673715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 512/1045] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:01.677099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.726979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.775823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331408-db5d-4eb3-9c1c-f2b7f49a8941 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.777670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1e702-c562-43ec-8c5c-f2f0d5bdfca7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.809650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.810439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.810722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.810997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.811564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.812165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.812294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.812506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.812781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:01.813510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:01.813607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.814851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:01.815243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 534/1046] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:01.816006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.833158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 513/1047] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:01:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:01:01.834247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:01.877829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.953977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd222b-9505-43aa-9b07-c06e7b9c25b2 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.966297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:01.974255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bd076-e70c-447d-a3ca-54491ae82598 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:01.993878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:01.994990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:01.994990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:01.995217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:02.002936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:02.004414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:02.017163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:02.018074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:02.018360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:02.018640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:02.019354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:01:02.020112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:02.021058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:01:02.022091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:02.022589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:02.022683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 535/1048] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:01:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:02.029296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:02.044539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 514/1049] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 21:01:01 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:01:02.142246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:02.150594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f910d-3932-4297-b701-54aebe58acd5 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:02.190095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980d3ae-6339-4d11-9913-e5f20780bbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:02.190782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980d3ae-6339-4d11-9913-e5f20780bbef None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:02.191066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980d3ae-6339-4d11-9913-e5f20780bbef None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:02.191345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980d3ae-6339-4d11-9913-e5f20780bbef None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:02.192149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980d3ae-6339-4d11-9913-e5f20780bbef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:02.192497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980d3ae-6339-4d11-9913-e5f20780bbef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:02.194080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980d3ae-6339-4d11-9913-e5f20780bbef None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:02.209236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 536/1050] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:01:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:02.214841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:02.325974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf51b3-8dfc-41aa-a130-e125e70a93ed None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:02.361453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d116d-beea-4052-8cb2-fc3e0c76a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:02.362116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d116d-beea-4052-8cb2-fc3e0c76a103 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:02.362403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d116d-beea-4052-8cb2-fc3e0c76a103 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:02.362682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d116d-beea-4052-8cb2-fc3e0c76a103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:02.363509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d116d-beea-4052-8cb2-fc3e0c76a103 None admin] RBAC: Adding query filter params (role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=c1e4d798757a41cfad3454940c12bcab) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:02.363827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d116d-beea-4052-8cb2-fc3e0c76a103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:02.365302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d116d-beea-4052-8cb2-fc3e0c76a103 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:02.372076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 515/1051] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:02 2022] GET /identity/v3/role_assignments?user.id=c1e4d798757a41cfad3454940c12bcab&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:04.021351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630af48-b8af-467f-85c6-4d43556f5619 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.021865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630af48-b8af-467f-85c6-4d43556f5619 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.021865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630af48-b8af-467f-85c6-4d43556f5619 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.023361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 537/1052] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:04.028340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7436a-31fb-4a3f-bdf8-221b9c552a5a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.028753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7436a-31fb-4a3f-bdf8-221b9c552a5a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.028964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7436a-31fb-4a3f-bdf8-221b9c552a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.046020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-01d7436a-31fb-4a3f-bdf8-221b9c552a5a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:04.047210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-01d7436a-31fb-4a3f-bdf8-221b9c552a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:04.063060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:04.118453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 516/1053] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:04.142123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630af48-b8af-467f-85c6-4d43556f5619 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.251595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630af48-b8af-467f-85c6-4d43556f5619 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:04.276135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786c5f-4dc6-4b61-92c3-c3cccde6c96f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.276413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786c5f-4dc6-4b61-92c3-c3cccde6c96f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.277255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee786c5f-4dc6-4b61-92c3-c3cccde6c96f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.278780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 517/1054] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:04.283588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2ad4-3ae5-4492-9aa2-b59ead59561c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.283989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2ad4-3ae5-4492-9aa2-b59ead59561c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.284371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2ad4-3ae5-4492-9aa2-b59ead59561c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.286820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:04.287503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.287744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.288017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.302093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e83e2ad4-3ae5-4492-9aa2-b59ead59561c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:04.303377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e83e2ad4-3ae5-4492-9aa2-b59ead59561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:04.315205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:04.367823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:04.369313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:04.377985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 518/1055] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:01:04.401219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2ad4-3ae5-4492-9aa2-b59ead59561c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.488345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 538/1056] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:04.491595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:04.492746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.513327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2ad4-3ae5-4492-9aa2-b59ead59561c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:04.548112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617bdc7-21ab-4f30-9874-b49c1ee554af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:04.548994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617bdc7-21ab-4f30-9874-b49c1ee554af None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.549274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617bdc7-21ab-4f30-9874-b49c1ee554af None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.549545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617bdc7-21ab-4f30-9874-b49c1ee554af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.553700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:04.560792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617bdc7-21ab-4f30-9874-b49c1ee554af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e617bdc7-21ab-4f30-9874-b49c1ee554af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:04.568542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:04.569589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:04.570429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 519/1057] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:04.571167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241243fc-187c-4024-8ffd-1fc7e12eede0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.571699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241243fc-187c-4024-8ffd-1fc7e12eede0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.571699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241243fc-187c-4024-8ffd-1fc7e12eede0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.573123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 520/1058] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:04.575526 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241243fc-187c-4024-8ffd-1fc7e12eede0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.599777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c1b1b-1078-4f34-88e2-46991d369e05 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:04.634690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac8940-85ad-47bd-90c9-2b8c0e0583ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:04.635480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac8940-85ad-47bd-90c9-2b8c0e0583ba None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.635832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac8940-85ad-47bd-90c9-2b8c0e0583ba None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.636167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac8940-85ad-47bd-90c9-2b8c0e0583ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.646026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac8940-85ad-47bd-90c9-2b8c0e0583ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:04.647498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac8940-85ad-47bd-90c9-2b8c0e0583ba None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-7aac8940-85ad-47bd-90c9-2b8c0e0583ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:04.664959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:04.665999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:04.667603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:01:04.667603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:04.667603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:04.667603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:04.667603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 539/1059] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:04.668582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfccd5d-701b-47c7-8d3d-feb7d8adaf0e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.668652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfccd5d-701b-47c7-8d3d-feb7d8adaf0e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.668883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfccd5d-701b-47c7-8d3d-feb7d8adaf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.685451 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6cfccd5d-701b-47c7-8d3d-feb7d8adaf0e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:04.686635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6cfccd5d-701b-47c7-8d3d-feb7d8adaf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:04.691348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241243fc-187c-4024-8ffd-1fc7e12eede0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:04.725869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:04.726527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.726813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.727088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.727831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:04.728143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:04.729714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:04.738174 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 521/1060] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:04.740006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.742892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:04.756316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 540/1061] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:04.757147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfccd5d-701b-47c7-8d3d-feb7d8adaf0e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.800033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:04.849799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0737-21a6-4c3f-ab0e-e9ddf03e06cf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:04.864434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfccd5d-701b-47c7-8d3d-feb7d8adaf0e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:04.884474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:04.885126 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.885403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.885690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.887268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:04.887569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:04.888950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:04.898902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:04.899781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 522/1062] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:04.899921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:04.900083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:04.900359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] PATH_INFO: `/v3/users/324f44bfb93c44eeadada4b59b0cc0c4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:04.900583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.915149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] RBAC: Authorizing `identity:get_user(user_id=324f44bfb93c44eeadada4b59b0cc0c4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:04.916704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:04.918746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 541/1063] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/users/324f44bfb93c44eeadada4b59b0cc0c4 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:04.924999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:04.980409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.021728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f681e4-ec92-41c6-a7dd-bf26e21139f0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.047481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.055799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05bd2b-adfb-4827-8c99-da2e11617e46 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.061762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.062592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.062877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.063158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.075130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:05.083830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:05.084862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:05.085720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 523/1064] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:05.092857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:05.101987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.103142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.103445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.103727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.190846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.192333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.213279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961257a3-876a-413f-9521-4a4528fb2980 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.235870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.248743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.249413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.249690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.249966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.250704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:05.251009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.252430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.262757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 524/1065] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:05.268472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:05.289280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.297706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 542/1066] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 21:01:05.303653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:05.369264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cece3-da69-41be-a205-dc8271de2201 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.400629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a43235-68e2-4fc6-b6a2-ceddc055bdce None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.404627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.405420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.405699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.405969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.416324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.417906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:05.434904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:05.435897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:05.437021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:01:05.437021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:05.437021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:05.437021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:05.437378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.437378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.437378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.437586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 525/1067] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:05.437656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.437822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef5e2d924994fa58512c1b1563677b5)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.439227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.441233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 543/1068] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:05.441686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:05.446794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:05.475846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.507435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.538541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d90392d-4186-43c8-a151-0bc536b7fbe2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.544783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9b9c-3f62-4df5-8a58-16b5170dc694 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.571872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.572601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.572880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.573160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.573943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:05.574250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.575610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.578167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.578807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.579087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.579357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.580165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=1ef5e2d924994fa58512c1b1563677b5, user.id=324f44bfb93c44eeadada4b59b0cc0c4) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:05.580501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.581892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.586986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 526/1069] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:05.593988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 544/1070] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/role_assignments?user.id=324f44bfb93c44eeadada4b59b0cc0c4&scope.project.id=1ef5e2d924994fa58512c1b1563677b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:05.594181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:05.694933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.702194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09b57a-f788-4900-886b-6136ae5da5fd None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.737794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.738592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.738883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.739150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.747164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.748744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:01:05.763814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:05.764814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:05.765817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 527/1071] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:05.770745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:05.875144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec641b73-229c-4d79-b83a-d0415afa65be None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:05.900879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:05.910421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:05.911231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:05.911613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:05.911995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:05.912962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:05.913373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:05.914888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:05.934190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 545/1072] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:05.939358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:06.043955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3945a8-ebec-433a-8bfe-13d42c9eb314 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:06.080058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:06.080997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:06.081280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:06.081556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:06.094832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:06.096494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:06.115507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:06.116672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:06.117609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:01:06.117609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:06.117609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:06.117609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:06.117609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 528/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:06.122612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:06.220938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd63213-9dab-47d0-ac02-7205124c67fe None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:06.254693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:06.255357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:06.255643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:06.255924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:06.256681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:06.256992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:06.258356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:06.269448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 546/1074] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:06.275036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:06.286332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:06.381796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88129d23-6597-4d50-bec4-4f9040146be5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:06.414495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:06.415280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:06.415550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:06.415819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:06.422827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:06.424286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:01:06.437839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:06.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:06.439613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 529/1075] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:01:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:06.444847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:06.490217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:06.543521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713a84d-e149-475c-8196-787d68866e9b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:06.576026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e57036-bde9-43f1-a83e-a1437e84dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:06.576717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e57036-bde9-43f1-a83e-a1437e84dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:06.577002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e57036-bde9-43f1-a83e-a1437e84dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:06.577277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e57036-bde9-43f1-a83e-a1437e84dbb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:06.578050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e57036-bde9-43f1-a83e-a1437e84dbb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:06.578361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e57036-bde9-43f1-a83e-a1437e84dbb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:06.579783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e57036-bde9-43f1-a83e-a1437e84dbb8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:06.594012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 547/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:01:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:06.598883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:06.663642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:06.698792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775520-b191-41d3-94ff-7885ebca89e3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:06.733121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15264d-8ee0-422d-bd2e-4022ae4c6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:06.734010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15264d-8ee0-422d-bd2e-4022ae4c6afc None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:06.734296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15264d-8ee0-422d-bd2e-4022ae4c6afc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:06.734575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15264d-8ee0-422d-bd2e-4022ae4c6afc None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/c1e4d798757a41cfad3454940c12bcab/roles/f66c1fcfbb16462eaa1c8c84ab5aa0d3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:06.736830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15264d-8ee0-422d-bd2e-4022ae4c6afc None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=c1e4d798757a41cfad3454940c12bcab, role_id=f66c1fcfbb16462eaa1c8c84ab5aa0d3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:06.738272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15264d-8ee0-422d-bd2e-4022ae4c6afc None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:06.751202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 530/1077] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:01:06 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/c1e4d798757a41cfad3454940c12bcab/roles/f66c1fcfbb16462eaa1c8c84ab5aa0d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:01:07.748840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571432-4411-41d3-a055-a7544c3e0d7c None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:07.749358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571432-4411-41d3-a055-a7544c3e0d7c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:07.749470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571432-4411-41d3-a055-a7544c3e0d7c None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:07.750835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 548/1078] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:07.756221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad791f-2f3e-49a4-8721-acc5ad756ebe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:07.756622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad791f-2f3e-49a4-8721-acc5ad756ebe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:07.756777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad791f-2f3e-49a4-8721-acc5ad756ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:07.774147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-45ad791f-2f3e-49a4-8721-acc5ad756ebe None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:07.775320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-45ad791f-2f3e-49a4-8721-acc5ad756ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:07.844270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 531/1079] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:07.866089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c571432-4411-41d3-a055-a7544c3e0d7c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:07.968880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c571432-4411-41d3-a055-a7544c3e0d7c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:07.971204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:08.003177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:08.003964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:08.004272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:08.004543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:08.015193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:08.022868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:08.023958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:08.024876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 549/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:08.030155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad791f-2f3e-49a4-8721-acc5ad756ebe None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:08.086435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:08.128647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad791f-2f3e-49a4-8721-acc5ad756ebe None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:08.161687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:08.162347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:08.162627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:08.162900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:08.163646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:08.163951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:08.165363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:08.174176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 532/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:08.179722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:08.279964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d29b-55d6-4d92-857c-41c8a1bfaeee None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:08.314809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:08.315682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:08.315966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:08.316271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] PATH_INFO: `/v3/users/324f44bfb93c44eeadada4b59b0cc0c4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:08.317448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] RBAC: Authorizing `identity:get_user(user_id=324f44bfb93c44eeadada4b59b0cc0c4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:08.318883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:08.320688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 550/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:08 2022] GET /identity/v3/users/324f44bfb93c44eeadada4b59b0cc0c4 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:08.326472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:08.425340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f07d33-7f6b-4651-b8b5-40ad8a2a8465 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:08.446627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:08.462900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe61aeb-0fdf-45a9-a432-15da78097d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:08.463820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe61aeb-0fdf-45a9-a432-15da78097d4e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:08.464423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe61aeb-0fdf-45a9-a432-15da78097d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:08.464538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe61aeb-0fdf-45a9-a432-15da78097d4e None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:08.465639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe61aeb-0fdf-45a9-a432-15da78097d4e None admin] RBAC: Authorizing `identity:get_project(project_id=1ef5e2d924994fa58512c1b1563677b5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:08.467074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe61aeb-0fdf-45a9-a432-15da78097d4e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:08.468817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 533/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:08 2022] GET /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:08.474937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:08.506462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:08.574845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b601d8-3c5f-4d73-a499-663a73945066 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:08.611708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752e8be-e20b-4e26-973f-a6eb661bc2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:08.612644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752e8be-e20b-4e26-973f-a6eb661bc2d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:08.612928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752e8be-e20b-4e26-973f-a6eb661bc2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:08.613201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752e8be-e20b-4e26-973f-a6eb661bc2d9 None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5/users/324f44bfb93c44eeadada4b59b0cc0c4/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:08.615125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752e8be-e20b-4e26-973f-a6eb661bc2d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef5e2d924994fa58512c1b1563677b5, user_id=324f44bfb93c44eeadada4b59b0cc0c4, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:08.616581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752e8be-e20b-4e26-973f-a6eb661bc2d9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:08.629679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 551/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:01:08 2022] PUT /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5/users/324f44bfb93c44eeadada4b59b0cc0c4/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:01:08.885390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f781c-96af-4fa1-8049-1adc9e653e4e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:08.886477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f781c-96af-4fa1-8049-1adc9e653e4e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:08.886477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f781c-96af-4fa1-8049-1adc9e653e4e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:08.887800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 534/1085] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:08.893053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a137-159b-42f3-b67e-eed5df50afdc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:08.893467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a137-159b-42f3-b67e-eed5df50afdc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:08.893607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a137-159b-42f3-b67e-eed5df50afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:08.910967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-99b4a137-159b-42f3-b67e-eed5df50afdc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:08.912148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-99b4a137-159b-42f3-b67e-eed5df50afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:08.979034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 552/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:01:09.002842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f781c-96af-4fa1-8049-1adc9e653e4e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:09.108302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f781c-96af-4fa1-8049-1adc9e653e4e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:09.141990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:09.142723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:09.143003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:09.143274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:09.155511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:09.163596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:09.164724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:09.166107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 535/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Jun 16 21:01:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:09.170761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a137-159b-42f3-b67e-eed5df50afdc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:09.194064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:09.269590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a137-159b-42f3-b67e-eed5df50afdc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:09.303500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:09.304158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:09.304468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:09.304739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:09.305474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:09.305776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:09.307133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:09.315899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 553/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 16 21:01:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:09.321609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:09.371366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:09.422506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f149e3-31dd-4984-a3cd-1bd5b61c5735 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:09.456134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:09.456945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:09.457230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:09.457507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:09.467308 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:09.468787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:09.490541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:09.497003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:09.498248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:01:09.498248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:09.498248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:09.498248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:09.498248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 536/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:09.499941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:09.583957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:09.600917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b17e88-9a14-4718-ab5b-ecb0cc5cbdb9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:09.634519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:09.635171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:09.635450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:09.635723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:09.636464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:09.636763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:09.638111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:09.649847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 554/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:09.655646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:09.751887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:09.754798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3023b-1e8c-46d5-9904-c03987994fa9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:09.788974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:09.789766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:09.790052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:09.790332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:09.797895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:09.799336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:01:09.813939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:09.815061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 21:01:09.816252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:09.819880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 537/1091] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Jun 16 21:01:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:09.820946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:09.918781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e750217-8e1c-40df-8a24-7fbf32b43e2e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:09.951902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:09.952589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:09.952869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:09.953143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:09.953959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:09.954266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:09.955672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:09.972051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 555/1092] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Jun 16 21:01:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:09.977950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:10.074240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1302e-5c11-486f-846f-86fb5d99af63 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:10.106284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:10.106911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:10.107191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:10.107464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:10.134424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:10.175040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:10.176521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:10.272536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 538/1093] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:10.278960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:10.281889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:10.379281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593fa386-dda2-4ecb-9fcc-cb8f893fa3de None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:10.413698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:10.414503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:10.414791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:10.415067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:10.425229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:10.426672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:10.444112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:10.445463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:10.446379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:01:10.446379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:10.446379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:01:10.446379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:10.446379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 556/1094] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:10.452087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:10.509576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:10.550105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7493d-adc8-4c11-9f8e-b0c8db09efb7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:10.583561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66598ca8-3310-4933-8bdd-b139b186cbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:10.584257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66598ca8-3310-4933-8bdd-b139b186cbce None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:10.584544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66598ca8-3310-4933-8bdd-b139b186cbce None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:10.584820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66598ca8-3310-4933-8bdd-b139b186cbce None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:10.585565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66598ca8-3310-4933-8bdd-b139b186cbce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:10.585874 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66598ca8-3310-4933-8bdd-b139b186cbce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:10.587243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66598ca8-3310-4933-8bdd-b139b186cbce None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:10.603947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 539/1095] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:10.605760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:10.661745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:10.709426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2ffd-c3b7-4f4f-9d66-bcebef7e6b69 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:10.744247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:10.745566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:10.745960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:10.746495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:10.753356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:10.754794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:10.756365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ecae3-df57-4eaa-8310-2935ea02ae58 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:10.756659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ecae3-df57-4eaa-8310-2935ea02ae58 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:10.756935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ecae3-df57-4eaa-8310-2935ea02ae58 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:10.758470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 540/1096] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:01:10.763667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b6546-8d47-436f-8b8c-4fea06ed713a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:10.763957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b6546-8d47-436f-8b8c-4fea06ed713a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:10.764262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b6546-8d47-436f-8b8c-4fea06ed713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:01:10.768958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:10.770054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:10.770963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 557/1097] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:10.775682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:10.783313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c18b6546-8d47-436f-8b8c-4fea06ed713a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:10.784622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c18b6546-8d47-436f-8b8c-4fea06ed713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:10.850920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 541/1098] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:01:10.875280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b6546-8d47-436f-8b8c-4fea06ed713a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:10.876663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fde8f5-8449-4ea9-a767-d36bb060a6a8 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:10.890818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:10.911014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:10.911664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:10.911997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:10.912260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:10.913040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:10.913354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:10.914768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:10.923641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:10.928253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 558/1099] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:10.934015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:10.972951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b6546-8d47-436f-8b8c-4fea06ed713a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:11.006151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:11.006950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:11.007228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:11.007500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:11.017558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:11.025253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:11.026255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:11.027884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 542/1100] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:01:11.031242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada471d-f8d1-4861-8bd8-720b42a1c30e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:11.032853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:11.064780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:11.065428 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:11.065710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:11.065980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:11.066799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] RBAC: Adding query filter params (role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=c1e4d798757a41cfad3454940c12bcab) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:11.067109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:11.068554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:11.074968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 559/1101] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:10 2022] GET /identity/v3/role_assignments?user.id=c1e4d798757a41cfad3454940c12bcab&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=f66c1fcfbb16462eaa1c8c84ab5aa0d3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:11.138176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492dcce-f2f0-486a-9188-43c3c219a399 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:11.149372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:11.174955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:11.175544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:11.175821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:11.176092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:11.176870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:11.177172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:11.178561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:11.187569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 543/1102] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:11.193546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:11.235896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:11.301518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a033bf-c7bb-41fc-bd68-6a353bd4276b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:11.337026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:11.337897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:11.338175 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:11.338449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] PATH_INFO: `/v3/users/324f44bfb93c44eeadada4b59b0cc0c4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:11.340780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] RBAC: Authorizing `identity:get_user(user_id=324f44bfb93c44eeadada4b59b0cc0c4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:11.342208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:11.343841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 560/1103] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:11 2022] GET /identity/v3/users/324f44bfb93c44eeadada4b59b0cc0c4 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:11.350074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:11.453075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0690a-1ec0-4272-9965-d4d2850cda17 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:11.487464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:11.488103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:11.488424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:11.488698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:11.530188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:11.556206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:11.558198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:11.660762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 544/1104] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:11.666729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:11.773162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fba14-5f67-4f0e-a0b5-761b28ad39cb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:11.781236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:11.808841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7f182-813b-4eb7-9ce8-ce5864eb1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:11.809695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f182-813b-4eb7-9ce8-ce5864eb1e8d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:11.809976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f182-813b-4eb7-9ce8-ce5864eb1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:11.810248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7f182-813b-4eb7-9ce8-ce5864eb1e8d None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:11.811424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7f182-813b-4eb7-9ce8-ce5864eb1e8d None admin] RBAC: Authorizing `identity:get_project(project_id=1ef5e2d924994fa58512c1b1563677b5)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:11.812885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7f182-813b-4eb7-9ce8-ce5864eb1e8d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:11.814568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 561/1105] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:11 2022] GET /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:11.820923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:11.890891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:11.921552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b537f-f8b4-40c8-9b27-02cbe4c079b4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:11.955784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c15fb-ee1d-45c6-a9d3-f0e16e918987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:11.956474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c15fb-ee1d-45c6-a9d3-f0e16e918987 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:11.956753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c15fb-ee1d-45c6-a9d3-f0e16e918987 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:11.957025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c15fb-ee1d-45c6-a9d3-f0e16e918987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:11.957841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c15fb-ee1d-45c6-a9d3-f0e16e918987 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=1ef5e2d924994fa58512c1b1563677b5, user.id=324f44bfb93c44eeadada4b59b0cc0c4) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:11.958154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c15fb-ee1d-45c6-a9d3-f0e16e918987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:11.959577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c15fb-ee1d-45c6-a9d3-f0e16e918987 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:11.965895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 545/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:11 2022] GET /identity/v3/role_assignments?user.id=324f44bfb93c44eeadada4b59b0cc0c4&scope.project.id=1ef5e2d924994fa58512c1b1563677b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:14.110070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fc35e-21a3-4b61-af5d-808a846c66b8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:14.110604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fc35e-21a3-4b61-af5d-808a846c66b8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:14.110604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fc35e-21a3-4b61-af5d-808a846c66b8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:14.111982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 562/1107] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:14.117195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97533-4019-4f2c-9ee9-35a1885947c9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:14.117599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97533-4019-4f2c-9ee9-35a1885947c9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:14.117755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97533-4019-4f2c-9ee9-35a1885947c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:14.134719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-75d97533-4019-4f2c-9ee9-35a1885947c9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:14.135943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-75d97533-4019-4f2c-9ee9-35a1885947c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:14.199703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 546/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:14.223655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fc35e-21a3-4b61-af5d-808a846c66b8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:14.324046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fc35e-21a3-4b61-af5d-808a846c66b8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:14.357295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef5eae-d5ff-4433-9202-ba7a59c81cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:14.358072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef5eae-d5ff-4433-9202-ba7a59c81cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:14.358350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef5eae-d5ff-4433-9202-ba7a59c81cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:14.358620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef5eae-d5ff-4433-9202-ba7a59c81cb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:14.359769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef5eae-d5ff-4433-9202-ba7a59c81cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:14.361271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef5eae-d5ff-4433-9202-ba7a59c81cb4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:14.362808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 563/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:14.368435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97533-4019-4f2c-9ee9-35a1885947c9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:14.430867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:14.464936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97533-4019-4f2c-9ee9-35a1885947c9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:14.497643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c6109-2f54-49a7-b410-3614113c547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:14.498297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c6109-2f54-49a7-b410-3614113c547e None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:14.498574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c6109-2f54-49a7-b410-3614113c547e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:14.498843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c6109-2f54-49a7-b410-3614113c547e None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:14.499549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c6109-2f54-49a7-b410-3614113c547e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:14.500982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c6109-2f54-49a7-b410-3614113c547e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:14.519460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 547/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 21:01:14 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:01:16.674410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1054e7-cd9f-4aeb-ac66-4345b52f9df7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:16.674962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1054e7-cd9f-4aeb-ac66-4345b52f9df7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:16.674962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1054e7-cd9f-4aeb-ac66-4345b52f9df7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:16.676356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 564/1111] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:16.681524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508526c-e754-4217-a09b-de4ee2e89d63 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:16.681929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508526c-e754-4217-a09b-de4ee2e89d63 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:16.682083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508526c-e754-4217-a09b-de4ee2e89d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:16.699723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b508526c-e754-4217-a09b-de4ee2e89d63 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:16.700947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b508526c-e754-4217-a09b-de4ee2e89d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:16.767017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 548/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:16.790626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1054e7-cd9f-4aeb-ac66-4345b52f9df7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:16.834069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:16.891113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1054e7-cd9f-4aeb-ac66-4345b52f9df7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:16.923748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:16.924618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:16.924898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:16.925166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] PATH_INFO: `/v3/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:16.926607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] RBAC: Authorizing `identity:get_role(role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:16.927964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:16.929339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 565/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:16 2022] GET /identity/v3/roles/0f03c426f04e463da379c4eda6247694 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:16.935109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508526c-e754-4217-a09b-de4ee2e89d63 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:16.986687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:17.033263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508526c-e754-4217-a09b-de4ee2e89d63 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:17.065545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:17.066412 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:17.066695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:17.066970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] PATH_INFO: `/v3/users/d9376e5e026a4be19453129d1b73248c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:17.080115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] RBAC: Authorizing `identity:get_user(user_id=d9376e5e026a4be19453129d1b73248c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:17.081585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:17.083215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 549/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:16 2022] GET /identity/v3/users/d9376e5e026a4be19453129d1b73248c => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:17.089440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:17.185359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdbba3-5a23-4fbe-b22a-da2e0afcb070 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:17.196106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:17.220233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:17.220879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:17.221162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:17.221439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:17.294019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:17.296376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:17.393464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 566/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:17.399311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:17.497257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847f48-49a8-462f-8ad8-288c0ead8300 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:17.507188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:17.530257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785792d5-39f4-4f34-be57-899554218bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:17.531099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785792d5-39f4-4f34-be57-899554218bec None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:17.531379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785792d5-39f4-4f34-be57-899554218bec None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:17.531666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785792d5-39f4-4f34-be57-899554218bec None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:17.532802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785792d5-39f4-4f34-be57-899554218bec None admin] RBAC: Authorizing `identity:get_project(project_id=1ef5e2d924994fa58512c1b1563677b5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:17.534214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785792d5-39f4-4f34-be57-899554218bec None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:17.535873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 550/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:17 2022] GET /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:17.541915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:17.553840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:17.640268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae4a54-86eb-4d5f-9faa-ba80ba65bc29 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:17.673069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2baeaa1-d75f-46c1-9c64-1800ed6122aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:17.673716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baeaa1-d75f-46c1-9c64-1800ed6122aa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:17.674002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baeaa1-d75f-46c1-9c64-1800ed6122aa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:17.674281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2baeaa1-d75f-46c1-9c64-1800ed6122aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:17.675099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baeaa1-d75f-46c1-9c64-1800ed6122aa None admin] RBAC: Adding query filter params (role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=1ef5e2d924994fa58512c1b1563677b5, user.id=d9376e5e026a4be19453129d1b73248c) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:17.675634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baeaa1-d75f-46c1-9c64-1800ed6122aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:17.676856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2baeaa1-d75f-46c1-9c64-1800ed6122aa None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:17.682198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 567/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:17 2022] GET /identity/v3/role_assignments?user.id=d9376e5e026a4be19453129d1b73248c&scope.project.id=1ef5e2d924994fa58512c1b1563677b5&role.id=0f03c426f04e463da379c4eda6247694 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:19.776310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba711-895e-4403-b082-dd3aebd09f1b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:19.776875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba711-895e-4403-b082-dd3aebd09f1b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:19.777100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dba711-895e-4403-b082-dd3aebd09f1b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:19.778994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 551/1118] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:01:19.784997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852653-6b97-4834-b169-fde73773eeef None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:19.785418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852653-6b97-4834-b169-fde73773eeef None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:19.785557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62852653-6b97-4834-b169-fde73773eeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:19.806757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-62852653-6b97-4834-b169-fde73773eeef None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:19.807960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-62852653-6b97-4834-b169-fde73773eeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:19.874574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 568/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:19.896724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dba711-895e-4403-b082-dd3aebd09f1b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:19.993234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dba711-895e-4403-b082-dd3aebd09f1b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:20.025289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:20.026116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:20.026392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:20.026662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] PATH_INFO: `/v3/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:20.028287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] RBAC: Authorizing `identity:get_role(role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:20.029638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:20.030968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 552/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:19 2022] GET /identity/v3/roles/0f03c426f04e463da379c4eda6247694 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:20.036809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62852653-6b97-4834-b169-fde73773eeef None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:20.039814 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:20.134815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62852653-6b97-4834-b169-fde73773eeef None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:20.167693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:20.169632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:20.169914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:20.170189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] PATH_INFO: `/v3/users/d9376e5e026a4be19453129d1b73248c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:20.171369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] RBAC: Authorizing `identity:get_user(user_id=d9376e5e026a4be19453129d1b73248c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:20.172836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:20.174455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 569/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:20 2022] GET /identity/v3/users/d9376e5e026a4be19453129d1b73248c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:20.180221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:20.225329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:20.275851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9eef5-9eb4-4edc-9a5a-c5cd8a506d9a None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:20.308989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a53583-57d5-4932-a47a-e86dcff1bb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:20.309838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53583-57d5-4932-a47a-e86dcff1bb5b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:20.310118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53583-57d5-4932-a47a-e86dcff1bb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:20.310389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a53583-57d5-4932-a47a-e86dcff1bb5b None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:20.311541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53583-57d5-4932-a47a-e86dcff1bb5b None admin] RBAC: Authorizing `identity:get_project(project_id=1ef5e2d924994fa58512c1b1563677b5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:20.312989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a53583-57d5-4932-a47a-e86dcff1bb5b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:20.314641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 553/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:20 2022] GET /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:20.320483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:20.387975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:20.422742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40249d5d-d836-43d9-8d0a-bcea17f13a4d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:20.457094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b91277-7146-490a-a87c-e73c31bf188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:20.457983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91277-7146-490a-a87c-e73c31bf188b None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:20.458262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91277-7146-490a-a87c-e73c31bf188b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:20.458536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b91277-7146-490a-a87c-e73c31bf188b None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5/users/d9376e5e026a4be19453129d1b73248c/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:20.460725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91277-7146-490a-a87c-e73c31bf188b None admin] RBAC: Authorizing `identity:create_grant(project_id=1ef5e2d924994fa58512c1b1563677b5, user_id=d9376e5e026a4be19453129d1b73248c, role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:20.462161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b91277-7146-490a-a87c-e73c31bf188b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:20.475206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 570/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:01:20 2022] PUT /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5/users/d9376e5e026a4be19453129d1b73248c/roles/0f03c426f04e463da379c4eda6247694 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:01:22.574986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327f0b-dce6-43a0-a3a2-d6a4de80a27e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:22.575574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327f0b-dce6-43a0-a3a2-d6a4de80a27e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:22.575574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35327f0b-dce6-43a0-a3a2-d6a4de80a27e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:22.577004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 554/1124] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:22.582371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4f59c-3c49-433f-b2f5-f1458a33c06c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:22.582787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4f59c-3c49-433f-b2f5-f1458a33c06c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:22.582930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4f59c-3c49-433f-b2f5-f1458a33c06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:22.601564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b9a4f59c-3c49-433f-b2f5-f1458a33c06c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:22.602741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b9a4f59c-3c49-433f-b2f5-f1458a33c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:22.668919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 571/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:22.693053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35327f0b-dce6-43a0-a3a2-d6a4de80a27e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:22.795295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35327f0b-dce6-43a0-a3a2-d6a4de80a27e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:22.808698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:22.829999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:22.831338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:22.831804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:22.832345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] PATH_INFO: `/v3/roles/0f03c426f04e463da379c4eda6247694` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:22.834327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] RBAC: Authorizing `identity:get_role(role_id=0f03c426f04e463da379c4eda6247694)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:22.835886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:22.837285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 555/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:22 2022] GET /identity/v3/roles/0f03c426f04e463da379c4eda6247694 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:22.844137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4f59c-3c49-433f-b2f5-f1458a33c06c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:22.902240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:22.940075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4f59c-3c49-433f-b2f5-f1458a33c06c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:22.973475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:22.974329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:22.974607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:22.974875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] PATH_INFO: `/v3/users/d9376e5e026a4be19453129d1b73248c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:22.976371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] RBAC: Authorizing `identity:get_user(user_id=d9376e5e026a4be19453129d1b73248c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:22.977792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:22.979396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 572/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:22 2022] GET /identity/v3/users/d9376e5e026a4be19453129d1b73248c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:22.985740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:23.082432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08c25b-b2bc-466e-83ac-6971953ce1e3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:23.114803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:23.115435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:23.115719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:23.115997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:23.163212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:23.181396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:23.182829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:23.278386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 556/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:23.285100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:23.382876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728451e3-e050-46e6-a5de-76c5ca1a1168 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:23.411042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:23.417091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e479541-67a4-43a9-ba93-a7061487a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:23.417940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479541-67a4-43a9-ba93-a7061487a258 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:23.418222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479541-67a4-43a9-ba93-a7061487a258 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:23.418495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e479541-67a4-43a9-ba93-a7061487a258 None admin] PATH_INFO: `/v3/projects/1ef5e2d924994fa58512c1b1563677b5` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:23.419702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e479541-67a4-43a9-ba93-a7061487a258 None admin] RBAC: Authorizing `identity:get_project(project_id=1ef5e2d924994fa58512c1b1563677b5)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:23.421159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e479541-67a4-43a9-ba93-a7061487a258 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:23.422835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 573/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:23 2022] GET /identity/v3/projects/1ef5e2d924994fa58512c1b1563677b5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:23.428835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:23.507494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:23.525687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e091f-305b-42d8-bca3-ed16658958d3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:23.559132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b51cbb-bb0a-4efb-b50f-f3be71715987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:23.559847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51cbb-bb0a-4efb-b50f-f3be71715987 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:23.560252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51cbb-bb0a-4efb-b50f-f3be71715987 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:23.560537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51cbb-bb0a-4efb-b50f-f3be71715987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:23.561348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b51cbb-bb0a-4efb-b50f-f3be71715987 None admin] RBAC: Adding query filter params (role.id=0f03c426f04e463da379c4eda6247694, scope.project.id=1ef5e2d924994fa58512c1b1563677b5, user.id=d9376e5e026a4be19453129d1b73248c) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:23.561664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b51cbb-bb0a-4efb-b50f-f3be71715987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:23.563089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b51cbb-bb0a-4efb-b50f-f3be71715987 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:23.568785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 557/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:23 2022] GET /identity/v3/role_assignments?user.id=d9376e5e026a4be19453129d1b73248c&scope.project.id=1ef5e2d924994fa58512c1b1563677b5&role.id=0f03c426f04e463da379c4eda6247694 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:25.680145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36573-b249-4c69-b356-3a9f15bac479 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:25.680753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36573-b249-4c69-b356-3a9f15bac479 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:25.680753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36573-b249-4c69-b356-3a9f15bac479 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:25.682086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 574/1131] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:25.687225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0514b7-6484-4f8e-9590-d9e3618b812f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:25.687638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0514b7-6484-4f8e-9590-d9e3618b812f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:25.687777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0514b7-6484-4f8e-9590-d9e3618b812f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:25.704528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-de0514b7-6484-4f8e-9590-d9e3618b812f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:25.705703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-de0514b7-6484-4f8e-9590-d9e3618b812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:25.769912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 558/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:25.793139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36573-b249-4c69-b356-3a9f15bac479 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:25.891013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36573-b249-4c69-b356-3a9f15bac479 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:25.923904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda004d5-8bc4-4611-addf-cbfc4a3bf8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:25.924714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda004d5-8bc4-4611-addf-cbfc4a3bf8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:25.925000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda004d5-8bc4-4611-addf-cbfc4a3bf8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:25.925277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda004d5-8bc4-4611-addf-cbfc4a3bf8e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:25.926444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda004d5-8bc4-4611-addf-cbfc4a3bf8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:25.927873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda004d5-8bc4-4611-addf-cbfc4a3bf8e6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:25.929843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 575/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:25.935991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0514b7-6484-4f8e-9590-d9e3618b812f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:26.010578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:26.034180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0514b7-6484-4f8e-9590-d9e3618b812f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:26.066845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59055791-a04a-4d00-bdfe-4844d30fd787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:26.067498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055791-a04a-4d00-bdfe-4844d30fd787 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:26.067780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055791-a04a-4d00-bdfe-4844d30fd787 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:26.068056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59055791-a04a-4d00-bdfe-4844d30fd787 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:26.068942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055791-a04a-4d00-bdfe-4844d30fd787 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:26.070368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59055791-a04a-4d00-bdfe-4844d30fd787 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:26.095431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 559/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:01:25 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:01:28.244239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691b6a6-369c-4110-b55e-b5bd40652263 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:28.244771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691b6a6-369c-4110-b55e-b5bd40652263 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:28.244771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691b6a6-369c-4110-b55e-b5bd40652263 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:28.246164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 576/1135] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:28.252134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32801f1-c897-4d15-b03e-baa564e82600 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:28.252594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32801f1-c897-4d15-b03e-baa564e82600 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:28.252728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32801f1-c897-4d15-b03e-baa564e82600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:28.269078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a32801f1-c897-4d15-b03e-baa564e82600 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:28.270262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a32801f1-c897-4d15-b03e-baa564e82600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:28.336873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 560/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:28.362533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691b6a6-369c-4110-b55e-b5bd40652263 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:28.427024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:28.460426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691b6a6-369c-4110-b55e-b5bd40652263 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:28.493762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46261bd-8340-4fed-9936-a84122880897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:28.494587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46261bd-8340-4fed-9936-a84122880897 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:28.494816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46261bd-8340-4fed-9936-a84122880897 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:28.495087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46261bd-8340-4fed-9936-a84122880897 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:28.496261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46261bd-8340-4fed-9936-a84122880897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:28.497915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46261bd-8340-4fed-9936-a84122880897 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:28.499493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 577/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:01:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:28.505305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32801f1-c897-4d15-b03e-baa564e82600 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:28.561630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:28.603020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32801f1-c897-4d15-b03e-baa564e82600 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:28.636944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90d16c-517a-4087-a634-cbc658a13768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:28.637615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90d16c-517a-4087-a634-cbc658a13768 None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:28.638422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90d16c-517a-4087-a634-cbc658a13768 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:28.638700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90d16c-517a-4087-a634-cbc658a13768 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:28.639413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90d16c-517a-4087-a634-cbc658a13768 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:28.640940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c90d16c-517a-4087-a634-cbc658a13768 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:28.660738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 561/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 21:01:28 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:01:30.941797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13db64-ab2c-40bb-8cce-6d4b410f42cb None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:30.942360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13db64-ab2c-40bb-8cce-6d4b410f42cb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:30.942360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13db64-ab2c-40bb-8cce-6d4b410f42cb None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:30.943638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 578/1139] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:30.948686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9afd-2e84-4fb8-b4ad-9e96f28b4b1c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:30.949078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9afd-2e84-4fb8-b4ad-9e96f28b4b1c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:30.949231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9afd-2e84-4fb8-b4ad-9e96f28b4b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:30.965909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-90ee9afd-2e84-4fb8-b4ad-9e96f28b4b1c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:30.967727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-90ee9afd-2e84-4fb8-b4ad-9e96f28b4b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:31.032472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 562/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:31.055555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13db64-ab2c-40bb-8cce-6d4b410f42cb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:31.158526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13db64-ab2c-40bb-8cce-6d4b410f42cb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:31.191932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:31.192675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:31.192958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:31.193233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:31.195046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:31.203590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:31.211241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:31.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:31.213594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 579/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:31.218480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee9afd-2e84-4fb8-b4ad-9e96f28b4b1c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:31.262410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:31.315382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee9afd-2e84-4fb8-b4ad-9e96f28b4b1c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:31.347904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:31.348581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:31.348861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:31.349134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:31.349865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:31.350167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:31.351774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:31.360000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 563/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:31.365857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:31.464295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d71b8-4aae-4993-a30c-2519a71ab2fa None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:31.501935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:31.502811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:31.503088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:31.503362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] PATH_INFO: `/v3/users/e4e97a287036448eaba6eabaae654585` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:31.516493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] RBAC: Authorizing `identity:get_user(user_id=e4e97a287036448eaba6eabaae654585)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:31.517931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:31.519579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 580/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:31 2022] GET /identity/v3/users/e4e97a287036448eaba6eabaae654585 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:31.525490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:31.624023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505705ff-d269-4766-a634-29d5584f28d9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:31.630612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:31.657732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:31.658368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:31.658653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:31.658927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:31.722253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:31.723620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:31.822904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 564/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:31.828998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:31.879997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:31.925270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b0c53-842c-4aad-b42c-2f20b99c21ac None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:31.957827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c76700-ca86-4103-a988-21c9612f7df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:31.958669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76700-ca86-4103-a988-21c9612f7df9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:31.958949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76700-ca86-4103-a988-21c9612f7df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:31.959221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c76700-ca86-4103-a988-21c9612f7df9 None admin] PATH_INFO: `/v3/projects/20e55be9becf45bc88cff71d5079a320` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:31.960386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c76700-ca86-4103-a988-21c9612f7df9 None admin] RBAC: Authorizing `identity:get_project(project_id=20e55be9becf45bc88cff71d5079a320)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:31.961795 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c76700-ca86-4103-a988-21c9612f7df9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:31.963442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 581/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:31 2022] GET /identity/v3/projects/20e55be9becf45bc88cff71d5079a320 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:31.969636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:31.977808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:32.068060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b551cf0-2f98-413e-963a-cbdeba39d89f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:32.101591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd4d63-d8a5-4650-a294-c0901e849a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:32.102239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4d63-d8a5-4650-a294-c0901e849a59 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:32.102518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4d63-d8a5-4650-a294-c0901e849a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:32.102790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4d63-d8a5-4650-a294-c0901e849a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:32.103607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd4d63-d8a5-4650-a294-c0901e849a59 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=20e55be9becf45bc88cff71d5079a320, user.id=e4e97a287036448eaba6eabaae654585) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:32.103918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd4d63-d8a5-4650-a294-c0901e849a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:32.105385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd4d63-d8a5-4650-a294-c0901e849a59 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:32.111421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 565/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:31 2022] GET /identity/v3/role_assignments?user.id=e4e97a287036448eaba6eabaae654585&scope.project.id=20e55be9becf45bc88cff71d5079a320&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:34.235194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7de6-78db-44f4-a918-49f44a919b4f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:34.235761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7de6-78db-44f4-a918-49f44a919b4f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:34.235761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e7de6-78db-44f4-a918-49f44a919b4f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:34.237150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 582/1147] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:34.243024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dee715-fedb-44c4-87f1-418c170f50b0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:34.243489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dee715-fedb-44c4-87f1-418c170f50b0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:34.243591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dee715-fedb-44c4-87f1-418c170f50b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:34.260227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-40dee715-fedb-44c4-87f1-418c170f50b0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:34.261416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-40dee715-fedb-44c4-87f1-418c170f50b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:34.321660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:34.326926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 566/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:34.349368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e7de6-78db-44f4-a918-49f44a919b4f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:34.449582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e7de6-78db-44f4-a918-49f44a919b4f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:34.471500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:34.486124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:34.486856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:34.487145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:34.487421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:34.498027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:34.505765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:34.506852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:34.507864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 583/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:34.513808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dee715-fedb-44c4-87f1-418c170f50b0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:34.613423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dee715-fedb-44c4-87f1-418c170f50b0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:34.650698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:34.651358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:34.651641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:34.651937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:34.652710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:34.653018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:34.654412 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:34.662285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 567/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:34.667962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:34.766369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d6c1-3236-47b3-82c4-6295f1d6db90 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:34.801266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:34.801266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:34.801266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:34.801598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] PATH_INFO: `/v3/users/e4e97a287036448eaba6eabaae654585` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:34.802628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] RBAC: Authorizing `identity:get_user(user_id=e4e97a287036448eaba6eabaae654585)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:34.804686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:34.808687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 584/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:34 2022] GET /identity/v3/users/e4e97a287036448eaba6eabaae654585 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:34.813640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:34.874953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:34.912585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ec7bc-035a-479e-98af-bec7f5b0ddd2 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:34.945405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05ea8c-cdb8-43de-a276-cf82615831df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:34.946259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ea8c-cdb8-43de-a276-cf82615831df None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:34.946541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ea8c-cdb8-43de-a276-cf82615831df None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:34.946818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05ea8c-cdb8-43de-a276-cf82615831df None admin] PATH_INFO: `/v3/projects/20e55be9becf45bc88cff71d5079a320` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:34.947990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05ea8c-cdb8-43de-a276-cf82615831df None admin] RBAC: Authorizing `identity:get_project(project_id=20e55be9becf45bc88cff71d5079a320)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:34.949452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05ea8c-cdb8-43de-a276-cf82615831df None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:34.951230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 568/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:34 2022] GET /identity/v3/projects/20e55be9becf45bc88cff71d5079a320 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:34.957230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:35.006163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:35.056775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3581a1-fe0c-462f-95ae-49359e2388cb None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:35.089276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736f06-413e-477f-a161-9f234b9f9ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:35.090161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736f06-413e-477f-a161-9f234b9f9ca1 None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:35.090437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736f06-413e-477f-a161-9f234b9f9ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:35.090707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736f06-413e-477f-a161-9f234b9f9ca1 None admin] PATH_INFO: `/v3/projects/20e55be9becf45bc88cff71d5079a320/users/e4e97a287036448eaba6eabaae654585/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:35.093630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736f06-413e-477f-a161-9f234b9f9ca1 None admin] RBAC: Authorizing `identity:create_grant(project_id=20e55be9becf45bc88cff71d5079a320, user_id=e4e97a287036448eaba6eabaae654585, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:35.095047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736f06-413e-477f-a161-9f234b9f9ca1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:35.109721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 585/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:01:34 2022] PUT /identity/v3/projects/20e55be9becf45bc88cff71d5079a320/users/e4e97a287036448eaba6eabaae654585/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:01:37.191531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31c7a-1ca1-449a-9869-b8ee977cf915 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:37.192084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31c7a-1ca1-449a-9869-b8ee977cf915 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:37.192084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31c7a-1ca1-449a-9869-b8ee977cf915 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:37.193454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 569/1154] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:37.198499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119d5d-b1de-47a0-a86e-bc98dbc4e91f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:37.198922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119d5d-b1de-47a0-a86e-bc98dbc4e91f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:37.199064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119d5d-b1de-47a0-a86e-bc98dbc4e91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:37.216959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e4119d5d-b1de-47a0-a86e-bc98dbc4e91f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:37.218138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e4119d5d-b1de-47a0-a86e-bc98dbc4e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:37.284084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 586/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:37.308444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31c7a-1ca1-449a-9869-b8ee977cf915 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:37.409782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31c7a-1ca1-449a-9869-b8ee977cf915 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:37.436445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:37.442336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:37.443059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:37.443336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:37.443606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:37.454550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:37.462088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:37.463177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:37.464239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 570/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:37.469631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119d5d-b1de-47a0-a86e-bc98dbc4e91f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:37.509104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:37.567748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119d5d-b1de-47a0-a86e-bc98dbc4e91f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:37.601135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:37.601807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:37.602091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:37.602365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:37.603106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:37.603894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:37.604806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:37.613033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 587/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:37.619047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:37.713822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafe0da-6f69-4252-9937-0fe05a80463f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:37.745986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:37.746835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:37.747113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:37.747458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] PATH_INFO: `/v3/users/e4e97a287036448eaba6eabaae654585` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:37.748719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] RBAC: Authorizing `identity:get_user(user_id=e4e97a287036448eaba6eabaae654585)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:37.750128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:37.751698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 571/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:37 2022] GET /identity/v3/users/e4e97a287036448eaba6eabaae654585 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:37.757249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:37.851584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:37.854935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd64577-911d-489e-8fea-f16012c8e878 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:37.888320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:37.889121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:37.889401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:37.889672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:37.953142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:37.954556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:38.044824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:38.048595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 588/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:38.054166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:38.110351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:38.150111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f58f4-6a6e-4b24-88dc-8b52083f7e9d None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:38.183365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada9e95-605e-467a-a79d-594b4023c8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:38.184230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9e95-605e-467a-a79d-594b4023c8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:38.184513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9e95-605e-467a-a79d-594b4023c8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:38.185307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada9e95-605e-467a-a79d-594b4023c8a5 None admin] PATH_INFO: `/v3/projects/20e55be9becf45bc88cff71d5079a320` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:38.186599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada9e95-605e-467a-a79d-594b4023c8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=20e55be9becf45bc88cff71d5079a320)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:38.188024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada9e95-605e-467a-a79d-594b4023c8a5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:38.189716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 572/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:38 2022] GET /identity/v3/projects/20e55be9becf45bc88cff71d5079a320 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:38.195873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:38.292166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707da0-27e9-49ec-bad3-9b61b2c01fc0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:38.325272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957426fb-3b3d-423c-8044-4284fd4ccbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:38.326719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957426fb-3b3d-423c-8044-4284fd4ccbbe None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:38.326719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957426fb-3b3d-423c-8044-4284fd4ccbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:38.326719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957426fb-3b3d-423c-8044-4284fd4ccbbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:38.327360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957426fb-3b3d-423c-8044-4284fd4ccbbe None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=20e55be9becf45bc88cff71d5079a320, user.id=e4e97a287036448eaba6eabaae654585) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:38.327675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957426fb-3b3d-423c-8044-4284fd4ccbbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:38.329155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957426fb-3b3d-423c-8044-4284fd4ccbbe None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:38.334920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 589/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:38 2022] GET /identity/v3/role_assignments?user.id=e4e97a287036448eaba6eabaae654585&scope.project.id=20e55be9becf45bc88cff71d5079a320&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:40.480840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab969bb-78bd-4ab2-9ec4-6b4a3d9df676 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:40.481508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab969bb-78bd-4ab2-9ec4-6b4a3d9df676 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:40.481508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab969bb-78bd-4ab2-9ec4-6b4a3d9df676 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:40.482822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 573/1162] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:40.488466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb55c-d652-438b-a724-d748deffd4ca None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:40.488884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb55c-d652-438b-a724-d748deffd4ca None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:40.489029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb55c-d652-438b-a724-d748deffd4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:40.505760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4efcb55c-d652-438b-a724-d748deffd4ca None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:40.506947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4efcb55c-d652-438b-a724-d748deffd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:40.563891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:40.572497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 590/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:40.595482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab969bb-78bd-4ab2-9ec4-6b4a3d9df676 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:40.695586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab969bb-78bd-4ab2-9ec4-6b4a3d9df676 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:40.720778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:40.729589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:40.730225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:40.730508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:40.730786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:40.795957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:40.797435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:40.893164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 574/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:40.899036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcb55c-d652-438b-a724-d748deffd4ca None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:40.995733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efcb55c-d652-438b-a724-d748deffd4ca None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:41.028473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34d7e-3977-4ce9-9a70-da61524431f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:41.030096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34d7e-3977-4ce9-9a70-da61524431f9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:41.030376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34d7e-3977-4ce9-9a70-da61524431f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:41.030648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34d7e-3977-4ce9-9a70-da61524431f9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:41.037140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d34d7e-3977-4ce9-9a70-da61524431f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:41.038575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d34d7e-3977-4ce9-9a70-da61524431f9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-66d34d7e-3977-4ce9-9a70-da61524431f9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:41.052431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:41.053696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:41.054833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 591/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:01:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:41.059533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:41.086368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:41.156839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74825740-1d29-42c3-92e6-44fd8921a8ca None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:41.189494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b95e0-9b2c-4f67-a3ed-d6ce42dd0922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:41.190136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b95e0-9b2c-4f67-a3ed-d6ce42dd0922 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:41.190423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b95e0-9b2c-4f67-a3ed-d6ce42dd0922 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:41.190699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b95e0-9b2c-4f67-a3ed-d6ce42dd0922 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:41.191413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b95e0-9b2c-4f67-a3ed-d6ce42dd0922 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:41.191720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b95e0-9b2c-4f67-a3ed-d6ce42dd0922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:41.193108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b95e0-9b2c-4f67-a3ed-d6ce42dd0922 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:41.200024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 575/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Jun 16 21:01:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:43.320726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0270c-3c34-4d41-bf97-1d24e52a104e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:43.321286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0270c-3c34-4d41-bf97-1d24e52a104e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:43.321286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0270c-3c34-4d41-bf97-1d24e52a104e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:43.322657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 592/1167] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:43.328881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731bf7a-ab72-45f6-9571-e7ccffff7027 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:43.329416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731bf7a-ab72-45f6-9571-e7ccffff7027 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:43.329416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731bf7a-ab72-45f6-9571-e7ccffff7027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:43.346098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0731bf7a-ab72-45f6-9571-e7ccffff7027 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:43.347267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0731bf7a-ab72-45f6-9571-e7ccffff7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:43.413482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 576/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:43.436545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0270c-3c34-4d41-bf97-1d24e52a104e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:43.494800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:43.540515 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf0270c-3c34-4d41-bf97-1d24e52a104e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:43.573678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa74269-7528-4450-b26f-ecc83f136919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:43.574281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74269-7528-4450-b26f-ecc83f136919 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:43.574564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74269-7528-4450-b26f-ecc83f136919 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:43.574838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa74269-7528-4450-b26f-ecc83f136919 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:43.575638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa74269-7528-4450-b26f-ecc83f136919 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:43.577017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa74269-7528-4450-b26f-ecc83f136919 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:43.596704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 593/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Jun 16 21:01:43 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:01:45.729045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe445fc-c375-48ec-8160-783e76c5c654 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:45.729594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe445fc-c375-48ec-8160-783e76c5c654 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:45.729594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe445fc-c375-48ec-8160-783e76c5c654 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:45.730974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 577/1170] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:45.736693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b96bb-fcab-416f-b82a-0d8149e2db73 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:45.737118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b96bb-fcab-416f-b82a-0d8149e2db73 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:45.737254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b96bb-fcab-416f-b82a-0d8149e2db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:45.753691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-155b96bb-fcab-416f-b82a-0d8149e2db73 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:45.754908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-155b96bb-fcab-416f-b82a-0d8149e2db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:45.819441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 594/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:45.843890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe445fc-c375-48ec-8160-783e76c5c654 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:45.866316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:45.944239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe445fc-c375-48ec-8160-783e76c5c654 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:45.977128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db01809-a73d-4675-a7cd-fdc4f1276861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:45.977976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01809-a73d-4675-a7cd-fdc4f1276861 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:45.978262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01809-a73d-4675-a7cd-fdc4f1276861 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:45.978540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01809-a73d-4675-a7cd-fdc4f1276861 None admin] PATH_INFO: `/v3/domains/b51d19c802de4442b901226213621c13` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:45.989926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db01809-a73d-4675-a7cd-fdc4f1276861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b51d19c802de4442b901226213621c13)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:45.991373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db01809-a73d-4675-a7cd-fdc4f1276861 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:45.993038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 578/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Jun 16 21:01:45 2022] GET /identity/v3/domains/b51d19c802de4442b901226213621c13 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:45.999454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b96bb-fcab-416f-b82a-0d8149e2db73 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:46.042064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:46.095049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b96bb-fcab-416f-b82a-0d8149e2db73 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:46.128028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7925a5d-e8ac-4f86-afed-6772786fc711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:46.128649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925a5d-e8ac-4f86-afed-6772786fc711 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:46.128928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925a5d-e8ac-4f86-afed-6772786fc711 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:46.129200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7925a5d-e8ac-4f86-afed-6772786fc711 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:46.129889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925a5d-e8ac-4f86-afed-6772786fc711 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:46.131333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7925a5d-e8ac-4f86-afed-6772786fc711 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:46.155677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 595/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:01:45 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:01:48.285678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70de09f-1864-4dec-9a07-5b2d6ae3ccb8 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:48.286240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70de09f-1864-4dec-9a07-5b2d6ae3ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:48.286240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70de09f-1864-4dec-9a07-5b2d6ae3ccb8 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:48.287596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 579/1174] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:48.292950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56042-2b28-4c77-9765-7be0aac9fd20 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:48.293337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56042-2b28-4c77-9765-7be0aac9fd20 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:48.293517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed56042-2b28-4c77-9765-7be0aac9fd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:48.311307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8ed56042-2b28-4c77-9765-7be0aac9fd20 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:48.312529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8ed56042-2b28-4c77-9765-7be0aac9fd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:48.377849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 596/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:48.402325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70de09f-1864-4dec-9a07-5b2d6ae3ccb8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:48.481249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:48.502512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70de09f-1864-4dec-9a07-5b2d6ae3ccb8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:48.534684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b553e9e-c109-487b-af95-82c536000ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:48.535535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b553e9e-c109-487b-af95-82c536000ffa None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:48.535865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b553e9e-c109-487b-af95-82c536000ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:48.536096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b553e9e-c109-487b-af95-82c536000ffa None admin] PATH_INFO: `/v3/domains/b51d19c802de4442b901226213621c13` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:48.537293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b553e9e-c109-487b-af95-82c536000ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=b51d19c802de4442b901226213621c13)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:48.538727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b553e9e-c109-487b-af95-82c536000ffa None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:48.540348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 580/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Jun 16 21:01:48 2022] GET /identity/v3/domains/b51d19c802de4442b901226213621c13 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:48.546562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56042-2b28-4c77-9765-7be0aac9fd20 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:48.572610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:48.645625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed56042-2b28-4c77-9765-7be0aac9fd20 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:48.680279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13a386-49f2-4247-ba2b-3719f573a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:48.680949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13a386-49f2-4247-ba2b-3719f573a91c None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:48.681235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13a386-49f2-4247-ba2b-3719f573a91c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:48.681513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13a386-49f2-4247-ba2b-3719f573a91c None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:48.682226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13a386-49f2-4247-ba2b-3719f573a91c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:48.683649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13a386-49f2-4247-ba2b-3719f573a91c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:48.703234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 597/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 21:01:48 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:01:50.911524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c107b-e6c8-42d4-ad1e-5290b85cf679 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:50.912049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c107b-e6c8-42d4-ad1e-5290b85cf679 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:50.912049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c107b-e6c8-42d4-ad1e-5290b85cf679 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:50.913396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 581/1178] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:50.918464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fa25-3cf1-491d-9c29-f21f8389f4d2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:50.918872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fa25-3cf1-491d-9c29-f21f8389f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:50.919016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494fa25-3cf1-491d-9c29-f21f8389f4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:50.937908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7494fa25-3cf1-491d-9c29-f21f8389f4d2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:50.941622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7494fa25-3cf1-491d-9c29-f21f8389f4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:51.009860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 598/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:01:51.033549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c107b-e6c8-42d4-ad1e-5290b85cf679 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:51.140855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c107b-e6c8-42d4-ad1e-5290b85cf679 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:51.172712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:51.173427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:51.173701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:51.173967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:51.183966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:51.191663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:51.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:51.193837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 582/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:51.198879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494fa25-3cf1-491d-9c29-f21f8389f4d2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:51.213579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:51.300005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494fa25-3cf1-491d-9c29-f21f8389f4d2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:51.333510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:51.334167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:51.334445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:51.334717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:51.335471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:51.335775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:51.337168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:51.345658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 599/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:01:51.351707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:51.362739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:51.449490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ff491-8293-47fd-bc9c-50a47a14c0c3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:51.482553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53508-1470-4492-9872-d3c267be283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:51.483399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53508-1470-4492-9872-d3c267be283f None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:51.483675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53508-1470-4492-9872-d3c267be283f None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:51.483944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a53508-1470-4492-9872-d3c267be283f None admin] PATH_INFO: `/v3/users/7ef13d79d7424d3990a38ff1340488d1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:51.496382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a53508-1470-4492-9872-d3c267be283f None admin] RBAC: Authorizing `identity:get_user(user_id=7ef13d79d7424d3990a38ff1340488d1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:51.497911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a53508-1470-4492-9872-d3c267be283f None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:51.499529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 583/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:51 2022] GET /identity/v3/users/7ef13d79d7424d3990a38ff1340488d1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:51.505256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:51.578431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:51.603892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f93f41-d859-4245-a1e0-b2bdb01b3178 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:51.636585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:51.637230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:51.637514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:51.637790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:51.703188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:51.704571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:51.775182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:51.800378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 600/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:51.806336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53508-1470-4492-9872-d3c267be283f None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:51.869644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:51.904135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a53508-1470-4492-9872-d3c267be283f None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:51.937435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287217d-caa9-4077-b3b1-6ff6a7151ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:51.938270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287217d-caa9-4077-b3b1-6ff6a7151ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:51.938548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287217d-caa9-4077-b3b1-6ff6a7151ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:51.938819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287217d-caa9-4077-b3b1-6ff6a7151ca5 None admin] PATH_INFO: `/v3/projects/4e774ccaf74247a798254c68d9bfb4ab` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:51.939956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287217d-caa9-4077-b3b1-6ff6a7151ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e774ccaf74247a798254c68d9bfb4ab)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:51.941406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287217d-caa9-4077-b3b1-6ff6a7151ca5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:51.943067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 584/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:51 2022] GET /identity/v3/projects/4e774ccaf74247a798254c68d9bfb4ab => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:51.949156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:52.047626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38048-2650-4b97-be9b-46e9e1f59e6e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:52.081007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df67946-dece-49b0-a964-a1c4b6052327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:52.081648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67946-dece-49b0-a964-a1c4b6052327 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:52.081933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67946-dece-49b0-a964-a1c4b6052327 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:52.082210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67946-dece-49b0-a964-a1c4b6052327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:52.083028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67946-dece-49b0-a964-a1c4b6052327 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=4e774ccaf74247a798254c68d9bfb4ab, user.id=7ef13d79d7424d3990a38ff1340488d1) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:52.083340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67946-dece-49b0-a964-a1c4b6052327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:52.084790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67946-dece-49b0-a964-a1c4b6052327 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:52.090080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 601/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:51 2022] GET /identity/v3/role_assignments?user.id=7ef13d79d7424d3990a38ff1340488d1&scope.project.id=4e774ccaf74247a798254c68d9bfb4ab&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:54.149078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49d41-7535-4adf-b329-87713549e58b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:54.149614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49d41-7535-4adf-b329-87713549e58b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:54.149614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e49d41-7535-4adf-b329-87713549e58b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:54.151001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 585/1186] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:54.157044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77008-64b1-4f43-8609-e4a52929b3f6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:54.157469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77008-64b1-4f43-8609-e4a52929b3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:54.157606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77008-64b1-4f43-8609-e4a52929b3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:54.174304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-44c77008-64b1-4f43-8609-e4a52929b3f6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:54.175477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-44c77008-64b1-4f43-8609-e4a52929b3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:54.204364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:54.241553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 602/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:54.263908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e49d41-7535-4adf-b329-87713549e58b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:54.361964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e49d41-7535-4adf-b329-87713549e58b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:54.394093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:54.394866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:54.395144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:54.395414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:54.397223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:54.406622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:54.415544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:54.416695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:01:54.422847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 586/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:54.423712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77008-64b1-4f43-8609-e4a52929b3f6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:54.519425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77008-64b1-4f43-8609-e4a52929b3f6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:54.552028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:54.552716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:54.552997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:54.553271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:54.554000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:54.554304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:54.555663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:54.563969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 603/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:54.569664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:54.666912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a3055-7709-4208-af95-505ffc40dabf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:54.698976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:54.699838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:54.700115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:54.700962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] PATH_INFO: `/v3/users/7ef13d79d7424d3990a38ff1340488d1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:54.702141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] RBAC: Authorizing `identity:get_user(user_id=7ef13d79d7424d3990a38ff1340488d1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:54.703559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:54.705183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 587/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:54 2022] GET /identity/v3/users/7ef13d79d7424d3990a38ff1340488d1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:54.710862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:54.740364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:54.809224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1061-354f-4c1f-b42a-dd061884fff6 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:54.841832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602921f-195b-4f62-bfa7-1f041a8fb87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:54.842687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602921f-195b-4f62-bfa7-1f041a8fb87e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:54.842965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602921f-195b-4f62-bfa7-1f041a8fb87e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:54.843234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602921f-195b-4f62-bfa7-1f041a8fb87e None admin] PATH_INFO: `/v3/projects/4e774ccaf74247a798254c68d9bfb4ab` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:54.844411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602921f-195b-4f62-bfa7-1f041a8fb87e None admin] RBAC: Authorizing `identity:get_project(project_id=4e774ccaf74247a798254c68d9bfb4ab)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:54.845886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b602921f-195b-4f62-bfa7-1f041a8fb87e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:54.847561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 604/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:54 2022] GET /identity/v3/projects/4e774ccaf74247a798254c68d9bfb4ab => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:54.853884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:54.914846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:54.953853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826489a-9eae-4821-916e-e3432f11fed4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:54.988760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ff944-056a-49eb-b3b9-4e3c790a8c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:54.989635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff944-056a-49eb-b3b9-4e3c790a8c5d None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:54.989917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff944-056a-49eb-b3b9-4e3c790a8c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:54.990193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ff944-056a-49eb-b3b9-4e3c790a8c5d None admin] PATH_INFO: `/v3/projects/4e774ccaf74247a798254c68d9bfb4ab/users/7ef13d79d7424d3990a38ff1340488d1/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:54.992135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ff944-056a-49eb-b3b9-4e3c790a8c5d None admin] RBAC: Authorizing `identity:create_grant(project_id=4e774ccaf74247a798254c68d9bfb4ab, user_id=7ef13d79d7424d3990a38ff1340488d1, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:54.993593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ff944-056a-49eb-b3b9-4e3c790a8c5d None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:55.006457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 588/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:01:54 2022] PUT /identity/v3/projects/4e774ccaf74247a798254c68d9bfb4ab/users/7ef13d79d7424d3990a38ff1340488d1/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:01:57.126862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdd78-9526-4f50-80be-d2f0885a6aff None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:57.127425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdd78-9526-4f50-80be-d2f0885a6aff None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:57.127425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfdd78-9526-4f50-80be-d2f0885a6aff None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:57.128823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 605/1193] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:01:57.133833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec66c-8cbf-438d-8faa-9fb805d67baf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:57.134266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec66c-8cbf-438d-8faa-9fb805d67baf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:57.134461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abec66c-8cbf-438d-8faa-9fb805d67baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:57.151457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1abec66c-8cbf-438d-8faa-9fb805d67baf None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:01:57.152684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1abec66c-8cbf-438d-8faa-9fb805d67baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:01:57.217470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 589/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:01:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:01:57.241522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfdd78-9526-4f50-80be-d2f0885a6aff None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:57.341567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:57.348234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfdd78-9526-4f50-80be-d2f0885a6aff None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:57.383473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:57.384222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:57.384508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:57.384779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:57.396010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:01:57.404298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:01:57.405438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:01:57.406504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 606/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:01:57.411495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec66c-8cbf-438d-8faa-9fb805d67baf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:57.461881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:57.508575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abec66c-8cbf-438d-8faa-9fb805d67baf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:57.540735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:57.541381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:57.541658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:57.541929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:57.542660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:57.542959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:57.544967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:57.552684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 590/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:01:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:57.558549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:57.657043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772b08-9c38-4295-afa5-f478518cf505 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:57.689363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:57.690211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:57.690487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:57.690753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] PATH_INFO: `/v3/users/7ef13d79d7424d3990a38ff1340488d1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:57.691911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] RBAC: Authorizing `identity:get_user(user_id=7ef13d79d7424d3990a38ff1340488d1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:57.693356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:57.694949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 607/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Jun 16 21:01:57 2022] GET /identity/v3/users/7ef13d79d7424d3990a38ff1340488d1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:57.700813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:57.796882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7531-86d0-4f58-ac03-30e566045316 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:57.809673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:57.829054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:57.829685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:57.829964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:57.830238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:57.895932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:57.897406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:57.992346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 591/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:01:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:01:57.998656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:58.025020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:58.094356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444471f-64c1-4742-b9e7-33a188e3bde4 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:58.127299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833859c-79f0-4974-bd63-4935a6f16f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:58.128144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833859c-79f0-4974-bd63-4935a6f16f17 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:58.128450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833859c-79f0-4974-bd63-4935a6f16f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:58.128717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833859c-79f0-4974-bd63-4935a6f16f17 None admin] PATH_INFO: `/v3/projects/4e774ccaf74247a798254c68d9bfb4ab` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:58.129869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833859c-79f0-4974-bd63-4935a6f16f17 None admin] RBAC: Authorizing `identity:get_project(project_id=4e774ccaf74247a798254c68d9bfb4ab)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:58.131271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833859c-79f0-4974-bd63-4935a6f16f17 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:58.132954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 608/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Jun 16 21:01:57 2022] GET /identity/v3/projects/4e774ccaf74247a798254c68d9bfb4ab => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:01:58.139938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:01:58.155470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:01:58.239056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94270672-c655-4aa2-bb6b-4d6b13215be9 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:01:58.272506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626086fc-99ec-44ee-a031-cdbdda8d8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:01:58.273095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626086fc-99ec-44ee-a031-cdbdda8d8eff None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:01:58.273380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626086fc-99ec-44ee-a031-cdbdda8d8eff None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:01:58.273657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626086fc-99ec-44ee-a031-cdbdda8d8eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:01:58.274476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626086fc-99ec-44ee-a031-cdbdda8d8eff None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=4e774ccaf74247a798254c68d9bfb4ab, user.id=7ef13d79d7424d3990a38ff1340488d1) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:01:58.274790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626086fc-99ec-44ee-a031-cdbdda8d8eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:01:58.276231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626086fc-99ec-44ee-a031-cdbdda8d8eff None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:01:58.282916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 592/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:01:58 2022] GET /identity/v3/role_assignments?user.id=7ef13d79d7424d3990a38ff1340488d1&scope.project.id=4e774ccaf74247a798254c68d9bfb4ab&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:02:08.123716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=53 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:08.279952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=61 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:55.099465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0c87-6c4d-44ff-80e0-f93f0b23f9af None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:55.100104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0c87-6c4d-44ff-80e0-f93f0b23f9af None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:55.100104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f0c87-6c4d-44ff-80e0-f93f0b23f9af None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:55.101603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 609/1201] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:02:55.107650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a550b9-8e85-486d-9452-b18ba5b5ecf7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:55.108137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a550b9-8e85-486d-9452-b18ba5b5ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:55.108267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a550b9-8e85-486d-9452-b18ba5b5ecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:55.127486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a3a550b9-8e85-486d-9452-b18ba5b5ecf7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:02:55.128838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a3a550b9-8e85-486d-9452-b18ba5b5ecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:02:55.206140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 593/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:02:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:02:55.231578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0c87-6c4d-44ff-80e0-f93f0b23f9af None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:55.376552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f0c87-6c4d-44ff-80e0-f93f0b23f9af None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:55.421546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:55.422393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:55.422711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:55.423790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:55.435408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:55.436930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:02:55.457649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:02:55.458770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:02:55.459915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:02:55.459915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:02:55.459915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:02:55.459915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:02:55.459915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 610/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:02:55.466060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a550b9-8e85-486d-9452-b18ba5b5ecf7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:55.591973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a550b9-8e85-486d-9452-b18ba5b5ecf7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:55.626749 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:55.634588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e17a9-92b6-410e-9903-8eb49acd79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:55.635278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e17a9-92b6-410e-9903-8eb49acd79c4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:55.635584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e17a9-92b6-410e-9903-8eb49acd79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:55.635883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e17a9-92b6-410e-9903-8eb49acd79c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:55.636723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e17a9-92b6-410e-9903-8eb49acd79c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:02:55.637037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e17a9-92b6-410e-9903-8eb49acd79c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:55.638753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1e17a9-92b6-410e-9903-8eb49acd79c4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:55.658859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 594/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:02:55.659067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:55.729211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:55.791280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6da0c-4bcf-4167-90ea-c5b6f54e2a52 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:55.838828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5faea-c1b1-4190-b101-2161b5ff4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:55.839939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5faea-c1b1-4190-b101-2161b5ff4448 None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:55.840306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5faea-c1b1-4190-b101-2161b5ff4448 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:55.840596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5faea-c1b1-4190-b101-2161b5ff4448 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:55.841491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5faea-c1b1-4190-b101-2161b5ff4448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:55.843298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5faea-c1b1-4190-b101-2161b5ff4448 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:55.871147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 611/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Jun 16 21:02:55 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:02:58.411585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8e68-256d-4ea3-84fc-8435a6520941 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:58.412201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8e68-256d-4ea3-84fc-8435a6520941 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:58.412201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8e68-256d-4ea3-84fc-8435a6520941 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:58.413578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 595/1206] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:02:58.419372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed483b1-fe76-4045-9088-f98c22ed8ed5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:58.420384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed483b1-fe76-4045-9088-f98c22ed8ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:58.420810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed483b1-fe76-4045-9088-f98c22ed8ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:58.441378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4ed483b1-fe76-4045-9088-f98c22ed8ed5 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:02:58.442873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4ed483b1-fe76-4045-9088-f98c22ed8ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:02:58.527266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 612/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:02:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:02:58.553084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8e68-256d-4ea3-84fc-8435a6520941 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:58.688352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8e68-256d-4ea3-84fc-8435a6520941 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:58.724289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:58.725080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:58.725364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:58.725642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:58.738055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:02:58.745947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:02:58.746993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:02:58.748004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 596/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:02:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:02:58.756906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed483b1-fe76-4045-9088-f98c22ed8ed5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:58.797663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:58.871570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed483b1-fe76-4045-9088-f98c22ed8ed5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:58.912217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:58.912427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:58.912713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:58.912984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:58.913790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:02:58.914108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:58.915483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:58.924447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 613/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:02:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:02:58.930029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:58.985184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:59.041535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cafc8-1940-4ce9-8f76-de9e742ef585 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:59.079863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:59.081237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:59.081237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:59.081237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:59.092362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:59.093894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:02:59.112849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:02:59.113843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:02:59.114786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:02:59.114786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:02:59.114786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:02:59.114786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:02:59.114786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 597/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:02:59.120610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:59.238278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:59.241667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fa105-ef80-4930-adbf-fa78b589379a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:59.281776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:59.282478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:59.282774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:59.283038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:59.283762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:02:59.284069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:59.285593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:59.299230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 614/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:02:59.305718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:59.439191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2543-669c-4b96-af48-2cf85cace985 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:59.440751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:02:59.478002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:59.479061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:59.479362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:59.479665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:59.489546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:59.489546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:02:59.507008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:02:59.508078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:02:59.509087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:02:59.512330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 598/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:02:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:02:59.514449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:59.641800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6dab2-ff2d-4a92-9096-eacc3ddd7108 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:59.688520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:59.689327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:59.689684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:59.689985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:59.691195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:02:59.691504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:02:59.693248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:02:59.717000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 615/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 16 21:02:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:02:59.723245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:02:59.850960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510ff0a-6265-481f-bb96-5da5ec1c7dcf None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:02:59.906033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:02:59.906945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:02:59.907403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:02:59.908007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:02:59.951909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:00.001400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:00.002976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:00.136592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 599/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:02:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:03:00.142717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:00.163985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:00.269052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2899f-43b4-49e3-b147-8fce1be7479b None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:00.307629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:00.308751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:00.308859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:00.309163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:00.321076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:00.322629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:00.343432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:00.344569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:00.345614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:00.345614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:00.345614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:00.345614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:00.345614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 616/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:00.350777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:00.418771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:00.462401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec3a4a-6f57-4219-b769-cdf90c123e67 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:00.501613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:00.502778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:00.502778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:00.502955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:00.503536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:00.503841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:00.505237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:00.518851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 600/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:00.524624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:00.615245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:00.647862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd90a3-81c9-41ea-9485-c879cde89188 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:00.686046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:00.686884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:00.687160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:00.687391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:00.695013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:00.696726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:03:00.712288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:00.713341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:00.714251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 617/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:03:00.719999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:00.831007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44742e9e-0ac0-4362-8e37-27acfdaea47c None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:00.859520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:00.873636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1e08-b697-43c8-97cc-80bb92e1c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:00.874477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1e08-b697-43c8-97cc-80bb92e1c065 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:00.874854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1e08-b697-43c8-97cc-80bb92e1c065 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:00.875258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1e08-b697-43c8-97cc-80bb92e1c065 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:00.876142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1e08-b697-43c8-97cc-80bb92e1c065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:00.876625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1e08-b697-43c8-97cc-80bb92e1c065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:00.878152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1e08-b697-43c8-97cc-80bb92e1c065 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:00.896222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 601/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:00.897672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:01.023941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf7e45-70f9-4b16-9983-1099b7ae4be7 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:01.073884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:01.088503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b5b2-240f-425a-966d-9ce1230eca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:01.089595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b5b2-240f-425a-966d-9ce1230eca59 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:01.090083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b5b2-240f-425a-966d-9ce1230eca59 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:01.090567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b5b2-240f-425a-966d-9ce1230eca59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:01.092826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b5b2-240f-425a-966d-9ce1230eca59 None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=3f7cc31562ab4ef5a72fadb9b8c98f41) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:01.093363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b5b2-240f-425a-966d-9ce1230eca59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:01.095969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b5b2-240f-425a-966d-9ce1230eca59 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:01.113534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 618/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:03:00 2022] GET /identity/v3/role_assignments?user.id=3f7cc31562ab4ef5a72fadb9b8c98f41&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:03.286110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b387-5f5b-4b30-ae08-96c3d9066a71 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:03.286648 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b387-5f5b-4b30-ae08-96c3d9066a71 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:03.286648 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689b387-5f5b-4b30-ae08-96c3d9066a71 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:03.288426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 602/1220] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:03.293753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64752-8986-457c-b088-1dbaddc69b1e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:03.294208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64752-8986-457c-b088-1dbaddc69b1e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:03.294437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d64752-8986-457c-b088-1dbaddc69b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:03.312420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-74d64752-8986-457c-b088-1dbaddc69b1e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:03.313689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-74d64752-8986-457c-b088-1dbaddc69b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:03.386497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 619/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:03.416924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689b387-5f5b-4b30-ae08-96c3d9066a71 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:03.527700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689b387-5f5b-4b30-ae08-96c3d9066a71 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:03.562448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:03.563238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:03.563511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:03.563773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:03.573646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:03:03.582492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:03.583666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:03.584575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 603/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:03.590056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64752-8986-457c-b088-1dbaddc69b1e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:03.698700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d64752-8986-457c-b088-1dbaddc69b1e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:03.723974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:03.738654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:03.739561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:03.739845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:03.740121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:03.740899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:03.741206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:03.743044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:03.752768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 620/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:03.758521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:03.806643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:03.865946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30485e7-ccb5-458a-8f25-07e921027bbc None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:03.905538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:03.906373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:03.906654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:03.906928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:03.917260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:03.918698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:03.937872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:03.939452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:03.941380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:03.941380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:03.941380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:03.941380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:03.941380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 604/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:03.945595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:04.053972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7287d-f8c7-4ffd-bf4e-1dd845734e82 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:04.090019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:04.090672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:04.090960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:04.091263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:04.091988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:04.092338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:04.093736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:04.105892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 621/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:04.112408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:04.218888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:04.225974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0b40c-2b20-4f5d-8490-b5824e424481 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:04.262451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:04.263414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:04.263722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:04.264066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:04.271680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:04.273161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:03:04.289379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:04.290903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:04.291843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 605/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:04.296708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:04.347973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:04.414076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07761f27-0340-4963-9a12-c7eb9e00c0f3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:04.451385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:04.452442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:04.452757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:04.453034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:04.454128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:04.454482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:04.456142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:04.476943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 622/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 16 21:03:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:04.483230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:04.603922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7b88-c959-4c8b-b5e2-72f9c93b8812 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:04.641283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cffa05-9127-415c-a128-66d934241113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:04.642086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cffa05-9127-415c-a128-66d934241113 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:04.642371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cffa05-9127-415c-a128-66d934241113 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:04.642646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cffa05-9127-415c-a128-66d934241113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:04.653855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cffa05-9127-415c-a128-66d934241113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:04.655325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cffa05-9127-415c-a128-66d934241113 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-40cffa05-9127-415c-a128-66d934241113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:04.674024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:04.675245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:04.676315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:04.676315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:04.676315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:04.676315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:04.676315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 606/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:04.681497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:04.797816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5efd2c-e0ab-4390-a81e-78c53d05e344 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:04.800703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:04.839034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:04.840030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:04.840429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:04.840826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:04.842023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:04.842401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:04.844076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:04.859408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 623/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:03:04.865179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cffa05-9127-415c-a128-66d934241113 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:04.876745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:04.982829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cffa05-9127-415c-a128-66d934241113 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:05.022244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:05.023197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:05.023516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:05.023870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:05.031868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:05.033343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:03:05.048052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:05.049149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:05.050307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 607/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:05.056847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:05.174341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212d14-914f-47cd-bfe2-f3e81d30790d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:05.212084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027923f4-12c7-4e32-bbfd-0399e6dd74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:05.212777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027923f4-12c7-4e32-bbfd-0399e6dd74f9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:05.213058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027923f4-12c7-4e32-bbfd-0399e6dd74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:05.213330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027923f4-12c7-4e32-bbfd-0399e6dd74f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:05.214145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027923f4-12c7-4e32-bbfd-0399e6dd74f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:05.214464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027923f4-12c7-4e32-bbfd-0399e6dd74f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:05.215970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027923f4-12c7-4e32-bbfd-0399e6dd74f9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:05.230520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 624/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:05.237674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:05.320553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:05.365555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487b28b-90dd-4429-8a8a-3aefded76282 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:05.405921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be385a1f-6f93-4b12-90d3-396e61d7de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:05.407108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385a1f-6f93-4b12-90d3-396e61d7de7b None admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:05.407409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385a1f-6f93-4b12-90d3-396e61d7de7b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:05.407765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be385a1f-6f93-4b12-90d3-396e61d7de7b None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/3f7cc31562ab4ef5a72fadb9b8c98f41/roles/744abd0f005f43e8bc93a7267c81c7bd` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:05.424974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be385a1f-6f93-4b12-90d3-396e61d7de7b None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=3f7cc31562ab4ef5a72fadb9b8c98f41, role_id=744abd0f005f43e8bc93a7267c81c7bd)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:05.426479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be385a1f-6f93-4b12-90d3-396e61d7de7b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:05.439329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 608/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:03:05 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/3f7cc31562ab4ef5a72fadb9b8c98f41/roles/744abd0f005f43e8bc93a7267c81c7bd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:03:07.724460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd87a49-e4e8-4755-9511-e3c811ffb1f6 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:07.725036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd87a49-e4e8-4755-9511-e3c811ffb1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:07.725036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd87a49-e4e8-4755-9511-e3c811ffb1f6 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:07.726393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 625/1233] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:07.732441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165f47-904f-4000-a21b-bd099d934fbe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:07.732829 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165f47-904f-4000-a21b-bd099d934fbe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:07.733031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f165f47-904f-4000-a21b-bd099d934fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:07.753933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4f165f47-904f-4000-a21b-bd099d934fbe None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:07.755144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4f165f47-904f-4000-a21b-bd099d934fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:07.838121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 609/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:07.866694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd87a49-e4e8-4755-9511-e3c811ffb1f6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:07.899347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:07.995169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd87a49-e4e8-4755-9511-e3c811ffb1f6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:08.033365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:08.034159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:08.034436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:08.034708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:08.046901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:03:08.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:08.057163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:08.058464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 626/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Jun 16 21:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:08.064344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165f47-904f-4000-a21b-bd099d934fbe None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:08.118165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:08.177601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f165f47-904f-4000-a21b-bd099d934fbe None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:08.214349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:08.215021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:08.215306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:08.215610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:08.216940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] RBAC: Adding query filter params (name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:08.217322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:08.218810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:08.227738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 610/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Jun 16 21:03:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:08.234778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:08.336198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:08.356710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5ed6-be22-4c49-b0b7-68010378216d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:08.400235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:08.400951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:08.401251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:08.401576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:08.413025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:08.414525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:08.435712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:08.437849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:08.439179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:08.439179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:08.439179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:08.439179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:08.439179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 627/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:03:08.443135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:08.556806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f46d7d-3514-447e-8438-55dd4780a6fe None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:08.568252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:08.599950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:08.600650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:08.600928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:08.601306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:08.602057 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:08.602363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:08.604042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:08.617350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 611/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:08.623814 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:08.730847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62e313-6a22-40c2-b1b8-8fee15d3678f None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:08.768501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:08.769445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:08.769828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:08.770167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:08.773705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:08.781044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:08.782804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:03:08.799885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:08.801253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:08.802371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 628/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:08.807392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:08.927959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b640f-d244-4160-af9b-a39b409f9099 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:08.963361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:08.964030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:08.964329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:08.964755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:08.965701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:08.966146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:08.968848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:08.994282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 612/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 16 21:03:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:08.995408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:09.109618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d70e13-b63c-4efd-9e30-8d04e52d7470 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:09.149081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:09.149870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:09.150279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:09.153044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:09.221679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:09.228979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:09.230431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:09.358316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 629/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:03:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:03:09.365020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:09.400054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:09.484053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382db3de-48f8-476d-afd7-6a281d531902 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:09.523364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:09.524140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:09.524442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:09.524759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:09.536433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:09.538715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:09.557830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:09.558920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:09.565230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:09.565230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:09.565230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:09.565230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:09.565230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 613/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:03:09.565713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:09.670952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:09.677815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606467bb-0e15-4dd8-a843-1e13b1931f60 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:09.714085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:09.714784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:09.715065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:09.715436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:09.716162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:09.717102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:09.718469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:09.730489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 630/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:03:09.736692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:09.823697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:09.853073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f68ac-af28-48f7-8487-d12b51f716c7 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:09.894823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:09.895794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:09.896152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:09.896482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:09.904282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:09.905933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:03:09.923004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:09.924092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:09.925327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 614/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:03:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:09.930389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:10.046195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb58066-bea1-49bb-a903-45adac7a70cc None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:10.085865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd70ba5-1649-4bb8-a2c7-0eaf2bb88e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:10.086549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70ba5-1649-4bb8-a2c7-0eaf2bb88e4b None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:10.086875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70ba5-1649-4bb8-a2c7-0eaf2bb88e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:10.087122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70ba5-1649-4bb8-a2c7-0eaf2bb88e4b None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:10.087913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd70ba5-1649-4bb8-a2c7-0eaf2bb88e4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:10.088279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd70ba5-1649-4bb8-a2c7-0eaf2bb88e4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:10.089687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd70ba5-1649-4bb8-a2c7-0eaf2bb88e4b None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:10.104015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 631/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:03:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:10.110852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:10.221446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601e3df-c31b-4e34-9e53-1b2a4a4c3721 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:10.258773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6c759-157e-4ffd-bc40-086aea96278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:10.259434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6c759-157e-4ffd-bc40-086aea96278c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:10.259716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6c759-157e-4ffd-bc40-086aea96278c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:10.259988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6c759-157e-4ffd-bc40-086aea96278c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:10.260850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6c759-157e-4ffd-bc40-086aea96278c None admin] RBAC: Adding query filter params (role.id=744abd0f005f43e8bc93a7267c81c7bd, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=3f7cc31562ab4ef5a72fadb9b8c98f41) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:10.261414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6c759-157e-4ffd-bc40-086aea96278c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:10.263778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6c759-157e-4ffd-bc40-086aea96278c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:10.271105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 615/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:03:10 2022] GET /identity/v3/role_assignments?user.id=3f7cc31562ab4ef5a72fadb9b8c98f41&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=744abd0f005f43e8bc93a7267c81c7bd => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:12.721778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9b05d-4c3f-4dde-bb4f-b0a39b37cad4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:12.722356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9b05d-4c3f-4dde-bb4f-b0a39b37cad4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:12.722458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9b05d-4c3f-4dde-bb4f-b0a39b37cad4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:12.723950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 632/1247] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:12.730258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f096bee-4759-41f8-beb2-07dfc79c389e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:12.730742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f096bee-4759-41f8-beb2-07dfc79c389e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:12.730858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f096bee-4759-41f8-beb2-07dfc79c389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:12.736435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:12.750584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3f096bee-4759-41f8-beb2-07dfc79c389e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:12.751792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3f096bee-4759-41f8-beb2-07dfc79c389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:12.833564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 616/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:12.859525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9b05d-4c3f-4dde-bb4f-b0a39b37cad4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:12.881169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:12.993757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9b05d-4c3f-4dde-bb4f-b0a39b37cad4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:13.037398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:13.038363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:13.038645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:13.038919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:13.050846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:03:13.059960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:13.061710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:13.062818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 633/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:13.067946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f096bee-4759-41f8-beb2-07dfc79c389e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:13.185903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f096bee-4759-41f8-beb2-07dfc79c389e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:13.223723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:13.229476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:13.230152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:13.230439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:13.230709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:13.231506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:13.232350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:13.233781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:13.242211 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 617/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:03:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:03:13.248747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:13.344536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:13.371485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a28d08-4ab3-4075-b672-70149f11f502 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:13.409750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:13.410556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:13.410842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:13.411123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:13.423045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:13.424640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:13.445148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:13.446381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:13.451992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:13.451992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:13.451992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:13.451992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:13.451992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 634/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:13.453042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:13.583136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325c2c9-9fa2-4097-8468-e5cd300f7ccb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:13.620502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:13.621195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:13.621481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:13.621756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:13.623009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:13.623328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:13.624812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:13.637111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 618/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:03:13.643608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:13.764472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccd36e-0da4-4273-b61f-659802282cc0 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:13.793632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:13.802561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:13.803372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:13.803655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:13.803935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:13.812123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:13.813602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:03:13.828729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:13.829917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:13.836131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 635/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:13.837015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:13.899069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:13.947256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1baffa-f118-42fa-b360-6cd521c3a006 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:13.985947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:13.986983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:13.987463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:13.988068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:13.989625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:13.990266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:13.992329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:14.015629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 619/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 16 21:03:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:03:14.021992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:14.133303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1506a3a-b62d-43da-b9a5-c40af4c9bafa None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:14.169491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:14.170147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:14.170387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:14.170683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:14.235443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:14.251787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:14.253299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:14.362822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 636/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:03:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:03:14.369060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:14.489145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a2465-8779-487d-af2a-1f97f8bc14a1 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:14.504534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:14.526517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:14.527322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:14.527611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:14.527894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:14.538606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:14.540219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:14.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:14.562004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:14.563229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:14.563229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:14.563229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:14.563229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:14.566051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 620/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:14.567205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:14.673561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:14.687748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877f268-2bf6-40ca-a8c3-76ad68f71471 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:14.728102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:14.729062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:14.729348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:14.729627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:14.730352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:14.730661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:14.732660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:14.745411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 637/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:14.751922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:14.866800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bbce9-a8a7-4eae-9d60-d5b1587cb37e None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:14.906009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:14.906856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:14.907206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:14.907552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:14.914841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:14.916422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:03:14.932376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:14.933600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:14.934935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 621/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:03:14.939667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:15.053755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74339d6-d510-4324-bc9c-d4be4f528a22 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:15.092333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c84a3-9171-4148-bcc9-299b03a8b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:15.093025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c84a3-9171-4148-bcc9-299b03a8b525 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:15.093308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c84a3-9171-4148-bcc9-299b03a8b525 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:15.093584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c84a3-9171-4148-bcc9-299b03a8b525 None admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:15.094401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c84a3-9171-4148-bcc9-299b03a8b525 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:15.094714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c84a3-9171-4148-bcc9-299b03a8b525 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:15.096473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c84a3-9171-4148-bcc9-299b03a8b525 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:15.111525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 638/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:15.117762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:15.147316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:15.228269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb205c8-e657-4944-bf76-4c1d599ac3cb None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:15.265685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e15fe-2a65-4ae0-be09-02f3acb91269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:15.266352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e15fe-2a65-4ae0-be09-02f3acb91269 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:15.266637 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e15fe-2a65-4ae0-be09-02f3acb91269 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:15.266914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e15fe-2a65-4ae0-be09-02f3acb91269 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:15.267753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e15fe-2a65-4ae0-be09-02f3acb91269 None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=3f7cc31562ab4ef5a72fadb9b8c98f41) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:15.268069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e15fe-2a65-4ae0-be09-02f3acb91269 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:15.269564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e15fe-2a65-4ae0-be09-02f3acb91269 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:15.275981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 622/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:03:15 2022] GET /identity/v3/role_assignments?user.id=3f7cc31562ab4ef5a72fadb9b8c98f41&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:03:17.433452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84137a8f-d5f4-4d3b-8c97-b22ac656ff6e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:17.434016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84137a8f-d5f4-4d3b-8c97-b22ac656ff6e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:17.434016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84137a8f-d5f4-4d3b-8c97-b22ac656ff6e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:17.436045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 639/1261] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:17.441273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca35732-21e8-42ba-8fcd-71be5ee8cdbe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:17.441691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca35732-21e8-42ba-8fcd-71be5ee8cdbe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:17.441825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca35732-21e8-42ba-8fcd-71be5ee8cdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:17.458203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8ca35732-21e8-42ba-8fcd-71be5ee8cdbe None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:17.459373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8ca35732-21e8-42ba-8fcd-71be5ee8cdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:17.523151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 623/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:17.546172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84137a8f-d5f4-4d3b-8c97-b22ac656ff6e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:17.556796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:17.647308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84137a8f-d5f4-4d3b-8c97-b22ac656ff6e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:17.680309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:17.681097 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:17.681380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:17.681655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:17.692121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:03:17.699743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:17.700829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:17.702301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 640/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:03:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:17.707343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca35732-21e8-42ba-8fcd-71be5ee8cdbe None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:17.725116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:17.804306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca35732-21e8-42ba-8fcd-71be5ee8cdbe None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:17.836482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:17.837128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:17.837406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:17.837676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:17.838406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:17.838714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:17.840073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:17.848495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 624/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:17.854405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:17.919083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:17.951878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73608fb-8547-48e8-8aef-5113e6cf8cc3 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:17.984272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:17.985051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:17.985338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:17.985618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:17.995736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:17.997205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:18.014536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:18.015545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:18.016794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:18.016794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:18.016794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:18.016794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:18.016794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 641/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:18.021459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:18.101014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:18.119954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65069552-a28c-45f2-bde3-cc99c70ab148 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:18.153202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:18.154004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:18.154377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:18.154657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:18.155378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:18.155687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:18.157087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:18.168425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 625/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:18.174672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:18.270874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39403e-540a-426f-83ff-d136d4aaa5f1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:18.290666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:18.304714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:18.305500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:18.305781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:18.306050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:18.313945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:18.315657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:03:18.333050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:18.334312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:18.335607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 642/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:18.340986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:18.450979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c5b769-ad66-45d7-bb15-6ccc5c525581 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:18.483978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:18.484669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:18.484953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:18.485230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:18.486055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:18.486366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:18.487782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:18.496026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:18.505601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 626/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 16 21:03:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:18.511324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:18.609838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf949e-5409-4a5d-a20c-44f581ac845d None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:18.641990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:18.642760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:18.643046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:18.643322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:18.653507 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:18.655734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:18.673267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:18.674339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:18.675447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:18.675447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:18.675447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:18.675447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:18.675447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 643/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:18.680153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:18.777881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad968ba3-e183-48a9-b3e5-ad71ef6ef2be None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:18.811156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:18.811809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:18.812092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:18.812395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:18.813112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:18.813421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:18.814787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:18.825782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 627/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:18.831375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:18.864491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:18.931415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3829dd-4078-4d4a-984c-4b68a150e257 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:18.964040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996879-77cf-4de4-a219-566972731c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:18.964845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996879-77cf-4de4-a219-566972731c76 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:18.965129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996879-77cf-4de4-a219-566972731c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:18.965405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83996879-77cf-4de4-a219-566972731c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:18.972681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83996879-77cf-4de4-a219-566972731c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:18.974116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83996879-77cf-4de4-a219-566972731c76 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-83996879-77cf-4de4-a219-566972731c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:03:18.988603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:18.989665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:18.990817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 644/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:18.995608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:19.054329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:19.095966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3083-2d50-4d67-88bc-4b65c75eefb3 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:19.129215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a25cb9-2a06-4434-97b9-c687902b9ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:19.129808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25cb9-2a06-4434-97b9-c687902b9ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:19.130095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25cb9-2a06-4434-97b9-c687902b9ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:19.130368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a25cb9-2a06-4434-97b9-c687902b9ed8 None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:19.131148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25cb9-2a06-4434-97b9-c687902b9ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:19.131457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25cb9-2a06-4434-97b9-c687902b9ed8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:19.132914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a25cb9-2a06-4434-97b9-c687902b9ed8 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:19.145392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 628/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:19.151319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996879-77cf-4de4-a219-566972731c76 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:19.240746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:19.250082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83996879-77cf-4de4-a219-566972731c76 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:19.282992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d580a-ed55-4cea-b68c-67909a684a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:19.283854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d580a-ed55-4cea-b68c-67909a684a3e None admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:19.284137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d580a-ed55-4cea-b68c-67909a684a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:19.284443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d580a-ed55-4cea-b68c-67909a684a3e None admin] PATH_INFO: `/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/3f7cc31562ab4ef5a72fadb9b8c98f41/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:19.286379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d580a-ed55-4cea-b68c-67909a684a3e None admin] RBAC: Authorizing `identity:create_grant(project_id=8da273c0fcb649d4bcbf8b2222cf12b5, user_id=3f7cc31562ab4ef5a72fadb9b8c98f41, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:19.287806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d580a-ed55-4cea-b68c-67909a684a3e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:19.300650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 645/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Jun 16 21:03:19 2022] PUT /identity/v3/projects/8da273c0fcb649d4bcbf8b2222cf12b5/users/3f7cc31562ab4ef5a72fadb9b8c98f41/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:03:21.391903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666fb8-3e8d-4b0b-ac3c-d0c22c86587a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:21.392481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666fb8-3e8d-4b0b-ac3c-d0c22c86587a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:21.392481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36666fb8-3e8d-4b0b-ac3c-d0c22c86587a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:21.393844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 629/1274] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:21.398980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d50fe-ad9c-4a7d-8cc4-717c6b2a0202 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:21.399376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d50fe-ad9c-4a7d-8cc4-717c6b2a0202 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:21.399543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d50fe-ad9c-4a7d-8cc4-717c6b2a0202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:21.416666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-fc3d50fe-ad9c-4a7d-8cc4-717c6b2a0202 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:21.417859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fc3d50fe-ad9c-4a7d-8cc4-717c6b2a0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:21.482756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 646/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:21.505338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36666fb8-3e8d-4b0b-ac3c-d0c22c86587a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:21.605605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36666fb8-3e8d-4b0b-ac3c-d0c22c86587a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:21.623786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:21.640886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:21.641667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:21.641995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:21.642216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:21.651939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 21:03:21.660580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:21.661675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:21.662699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 630/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Jun 16 21:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:21.667856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d50fe-ad9c-4a7d-8cc4-717c6b2a0202 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:21.747361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:21.766071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d50fe-ad9c-4a7d-8cc4-717c6b2a0202 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:21.799319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:21.799975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:21.800280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:21.800556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:21.801288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:21.801592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:21.802945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:21.811001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 647/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Jun 16 21:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:21.816837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:21.914467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f32c4-c755-455a-8aa5-5daa51eb71b0 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:21.945762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:21.946531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:21.946809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:21.947080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:21.957687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:21.959113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:21.976120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:21.977212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:21.978327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:21.978327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:21.978327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:21.978327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:21.978327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 631/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:21.983252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:22.080150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d588f2-81e8-4873-89eb-a7c3b3ca47c1 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:22.113302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:22.113965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:22.114250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:22.114529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:22.115251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:22.115560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:22.117043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:22.129028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 648/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:22.134607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:22.165994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:22.233208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54997f-1047-4638-8d7d-c9d43d273939 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:22.265822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:22.266613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:22.266892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:22.267159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:22.275052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:22.276506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 21:03:22.290834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:22.291954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:22.292992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 632/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:22.297838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:22.301593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:22.417844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa21e1a-8938-4aa5-b6c1-caacde66459a None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:22.451611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:22.452351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:22.452638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:22.452913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:22.453739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:22.454048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:22.455473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:22.472028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 649/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Jun 16 21:03:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:22.477877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:22.564125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:22.577464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f70e9-50ba-4d0c-a36c-8b7dec2fc59b None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:22.611362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:22.612017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:22.612337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:22.612618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:22.678450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:22.679831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:22.768279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:22.781160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 633/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Jun 16 21:03:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 21:03:22.787066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:22.847221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:22.886552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf59f95-2d29-4d85-bff5-85ec1d08609e None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:22.921028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:22.921816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:22.922099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:22.922381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:22.932257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:22.933656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 21:03:22.951485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:22.952386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:22.953308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 21:03:22.953308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 21:03:22.953308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 21:03:22.953308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:22.953308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 650/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:22.958456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:23.055352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a156add-aae2-495f-8fff-ac076b39a334 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:23.093585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:23.094239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:23.094523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:23.094804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:23.095521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:23.095830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:23.097237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:23.108778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 634/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Jun 16 21:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:23.114441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:23.212329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ebe31-007c-47ab-bbad-8a0cd1e9b6b9 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:23.225693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:23.245536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:23.246320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:23.246605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:23.246910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:23.254317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:23.255753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 21:03:23.270193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:23.271236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: ERROR keystone.server.flask.application Jun 16 21:03:23.272351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 651/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Jun 16 21:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:23.277084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:23.327119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:23.375208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e39c6-cf1c-4289-889b-a7bd28fd3475 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:23.418374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1832b8-308a-4bb6-93f3-cd8b1c396d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:23.419027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1832b8-308a-4bb6-93f3-cd8b1c396d5c None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:23.419306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1832b8-308a-4bb6-93f3-cd8b1c396d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:23.420190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1832b8-308a-4bb6-93f3-cd8b1c396d5c None admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:23.420976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1832b8-308a-4bb6-93f3-cd8b1c396d5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:23.421283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1832b8-308a-4bb6-93f3-cd8b1c396d5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:23.422707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1832b8-308a-4bb6-93f3-cd8b1c396d5c None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:23.434485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 635/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Jun 16 21:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:23.441171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:23.537513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bc01c-0b88-41a2-bf90-378dd61be30c None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:23.570319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63671d53-0ae5-45ce-9466-c0fcd6d36c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:23.570952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671d53-0ae5-45ce-9466-c0fcd6d36c5f None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:23.571231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671d53-0ae5-45ce-9466-c0fcd6d36c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:23.571504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63671d53-0ae5-45ce-9466-c0fcd6d36c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:23.572347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671d53-0ae5-45ce-9466-c0fcd6d36c5f None admin] RBAC: Adding query filter params (role.id=b7564b3ff8064aa09459135574f0a043, scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5, user.id=3f7cc31562ab4ef5a72fadb9b8c98f41) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:23.572655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671d53-0ae5-45ce-9466-c0fcd6d36c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:23.574066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63671d53-0ae5-45ce-9466-c0fcd6d36c5f None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:23.579891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 652/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Jun 16 21:03:23 2022] GET /identity/v3/role_assignments?user.id=3f7cc31562ab4ef5a72fadb9b8c98f41&scope.project.id=8da273c0fcb649d4bcbf8b2222cf12b5&role.id=b7564b3ff8064aa09459135574f0a043 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:25.699799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70511-857f-469e-a230-3213dc7a439c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:25.700337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70511-857f-469e-a230-3213dc7a439c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:25.700427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd70511-857f-469e-a230-3213dc7a439c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:25.702281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 636/1288] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:25.707272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ef8bb-e5ce-4e37-861c-ebfc0339dfa7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:25.707692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ef8bb-e5ce-4e37-861c-ebfc0339dfa7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:25.707830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ef8bb-e5ce-4e37-861c-ebfc0339dfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:25.724831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-289ef8bb-e5ce-4e37-861c-ebfc0339dfa7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:25.725995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-289ef8bb-e5ce-4e37-861c-ebfc0339dfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:25.754268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:25.791021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 653/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:25.813104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd70511-857f-469e-a230-3213dc7a439c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:25.913720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd70511-857f-469e-a230-3213dc7a439c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:25.924740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:25.948385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:25.949171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:25.949453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:25.949727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:25.950369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:25.953229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:25.964824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:25.966005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:25.967117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 637/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:03:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:25.971977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ef8bb-e5ce-4e37-861c-ebfc0339dfa7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:26.067920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ef8bb-e5ce-4e37-861c-ebfc0339dfa7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:26.100434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18e9ee-3f1c-4419-8139-4583b05a716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:26.101088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e9ee-3f1c-4419-8139-4583b05a716d None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:26.101369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e9ee-3f1c-4419-8139-4583b05a716d None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:26.101639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18e9ee-3f1c-4419-8139-4583b05a716d None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:26.102334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e9ee-3f1c-4419-8139-4583b05a716d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:26.102639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e9ee-3f1c-4419-8139-4583b05a716d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:26.104265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18e9ee-3f1c-4419-8139-4583b05a716d None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:26.109546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 654/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 16 21:03:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:26.115165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:26.211937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e7bfa-dcc7-4c22-b215-bf88998a21a5 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:26.245206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f4424-bdfb-45bc-ba2e-caed3f13ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:26.245857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f4424-bdfb-45bc-ba2e-caed3f13ac60 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:26.246142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f4424-bdfb-45bc-ba2e-caed3f13ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:26.246419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f4424-bdfb-45bc-ba2e-caed3f13ac60 None admin] PATH_INFO: `/v3/services` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:26.247121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f4424-bdfb-45bc-ba2e-caed3f13ac60 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:26.247431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f4424-bdfb-45bc-ba2e-caed3f13ac60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:26.249097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f4424-bdfb-45bc-ba2e-caed3f13ac60 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:26.253567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 638/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 16 21:03:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:28.352576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643dd9-2829-4a73-867f-24d2564a5330 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:28.353178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643dd9-2829-4a73-867f-24d2564a5330 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:28.354457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2643dd9-2829-4a73-867f-24d2564a5330 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:28.355969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 655/1293] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:28.361658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99b74-687a-467e-9090-4d152473f2d2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:28.362097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99b74-687a-467e-9090-4d152473f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:28.362205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb99b74-687a-467e-9090-4d152473f2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:28.381061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6bb99b74-687a-467e-9090-4d152473f2d2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:28.382321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6bb99b74-687a-467e-9090-4d152473f2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:28.414334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:28.453295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 639/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 21:03:28.475710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643dd9-2829-4a73-867f-24d2564a5330 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:28.506988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:28.574906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2643dd9-2829-4a73-867f-24d2564a5330 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:28.608392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74494c38-81c3-4c0d-a251-ac4169d8ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:28.609057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74494c38-81c3-4c0d-a251-ac4169d8ecba None admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:28.609342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74494c38-81c3-4c0d-a251-ac4169d8ecba None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:28.609621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74494c38-81c3-4c0d-a251-ac4169d8ecba None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:28.610352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74494c38-81c3-4c0d-a251-ac4169d8ecba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:28.611704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74494c38-81c3-4c0d-a251-ac4169d8ecba None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:28.624775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 656/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Jun 16 21:03:28 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:03:30.744062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec7b6-f701-421c-bbf1-63f22e062628 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:30.744655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec7b6-f701-421c-bbf1-63f22e062628 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:30.744655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ec7b6-f701-421c-bbf1-63f22e062628 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:30.746012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 640/1296] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:30.751825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb585-6d33-40cf-a5fe-d00064f067d7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:30.752253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb585-6d33-40cf-a5fe-d00064f067d7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:30.752497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114eb585-6d33-40cf-a5fe-d00064f067d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:30.769711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-114eb585-6d33-40cf-a5fe-d00064f067d7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:30.770888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-114eb585-6d33-40cf-a5fe-d00064f067d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:30.842782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 657/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:30.866330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec7b6-f701-421c-bbf1-63f22e062628 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:30.963550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ec7b6-f701-421c-bbf1-63f22e062628 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:30.995788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:30.996595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:30.996873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:30.997141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:30.998363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:30.999714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:31.011210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:31.012433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:31.013358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 641/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:03:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 21:03:31.018442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eb585-6d33-40cf-a5fe-d00064f067d7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:31.035895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:31.121852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114eb585-6d33-40cf-a5fe-d00064f067d7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:31.154650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:31.155297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:31.155576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:31.155843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:31.156561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:31.156864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:31.158222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:31.163195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 658/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 16 21:03:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:31.169142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:31.201361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:31.268314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84434fd8-75e1-447c-b5ed-77847c25bcb4 None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:31.301175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6995bb-a2ab-4cc3-acd2-bc4be41c2555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:31.301821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6995bb-a2ab-4cc3-acd2-bc4be41c2555 None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:31.302105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6995bb-a2ab-4cc3-acd2-bc4be41c2555 None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:31.302383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6995bb-a2ab-4cc3-acd2-bc4be41c2555 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:31.303163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6995bb-a2ab-4cc3-acd2-bc4be41c2555 None admin] RBAC: Adding query filter params (interface=public, service_id=93fa1f19eb114f16ab25558817a0d9cb, region_id=RegionOne) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:31.303480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6995bb-a2ab-4cc3-acd2-bc4be41c2555 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:31.304864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6995bb-a2ab-4cc3-acd2-bc4be41c2555 None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:31.309804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 642/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Jun 16 21:03:31 2022] GET /identity/v3/endpoints?service_id=93fa1f19eb114f16ab25558817a0d9cb&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:31.316763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:31.400843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:31.421521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53fc04-ad56-4392-8005-fc25acbf0040 None admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:31.455186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c77773-aa90-4331-9385-de139ec16954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:31.455845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77773-aa90-4331-9385-de139ec16954 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:31.456128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77773-aa90-4331-9385-de139ec16954 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:31.456434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c77773-aa90-4331-9385-de139ec16954 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:31.457110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c77773-aa90-4331-9385-de139ec16954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:31.458462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c77773-aa90-4331-9385-de139ec16954 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:31.465192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 659/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Jun 16 21:03:31 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:03:33.679510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd75286-85f1-40a7-a036-63e550140a0b None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:33.680055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd75286-85f1-40a7-a036-63e550140a0b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:33.680055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd75286-85f1-40a7-a036-63e550140a0b None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:33.681468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 643/1302] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:03:33.686470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b348-8606-4ef8-bc50-a41ca7bfd8cc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:33.686856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b348-8606-4ef8-bc50-a41ca7bfd8cc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:33.687019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9b348-8606-4ef8-bc50-a41ca7bfd8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:33.703347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5af9b348-8606-4ef8-bc50-a41ca7bfd8cc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:03:33.704549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5af9b348-8606-4ef8-bc50-a41ca7bfd8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:03:33.771643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 660/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:03:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 21:03:33.795636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd75286-85f1-40a7-a036-63e550140a0b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:33.888695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:33.895873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd75286-85f1-40a7-a036-63e550140a0b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:33.928118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:33.928928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:33.929217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:33.929493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] PATH_INFO: `/v3/services/placement` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:33.930137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:33.931500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 21:03:33.943279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 21:03:33.944468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application with Lock( Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self._enter() Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application return self.creator() Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application created_value = creator( Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: ERROR keystone.server.flask.application Jun 16 21:03:33.945503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 644/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Jun 16 21:03:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 21:03:33.950367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9b348-8606-4ef8-bc50-a41ca7bfd8cc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:34.025366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:34.050967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9b348-8606-4ef8-bc50-a41ca7bfd8cc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:34.083346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c314e-a092-4342-b0ed-f3a1d62bc343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:34.083997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c314e-a092-4342-b0ed-f3a1d62bc343 None admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:34.084307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c314e-a092-4342-b0ed-f3a1d62bc343 None admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:34.084582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c314e-a092-4342-b0ed-f3a1d62bc343 None admin] PATH_INFO: `/v3/services` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:34.085274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c314e-a092-4342-b0ed-f3a1d62bc343 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:03:34.085578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c314e-a092-4342-b0ed-f3a1d62bc343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:34.086945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c314e-a092-4342-b0ed-f3a1d62bc343 None admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:34.092532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 661/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Jun 16 21:03:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:03:34.098259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:03:34.196594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3f20c-4500-451f-bb8e-e1fc85c6bdde None admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:03:34.230525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92a315-6513-48b1-a130-651986259f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:03:34.231164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92a315-6513-48b1-a130-651986259f5e None admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:03:34.231444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92a315-6513-48b1-a130-651986259f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:03:34.231719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92a315-6513-48b1-a130-651986259f5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:03:34.233611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92a315-6513-48b1-a130-651986259f5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:03:34.234968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92a315-6513-48b1-a130-651986259f5e None admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:03:34.253442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 645/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Jun 16 21:03:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:03:44.088985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=30 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:03:44.248110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:38.137612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0956-0711-4899-a637-8cc979cd50a2 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:38.138155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0956-0711-4899-a637-8cc979cd50a2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:38.138155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f0956-0711-4899-a637-8cc979cd50a2 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:38.143582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 662/1307] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:38.144940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc47a81-c26c-4faf-b24e-e131724a93c2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:38.145385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc47a81-c26c-4faf-b24e-e131724a93c2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:38.145484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc47a81-c26c-4faf-b24e-e131724a93c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:38.220921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dfc47a81-c26c-4faf-b24e-e131724a93c2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:38.222184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dfc47a81-c26c-4faf-b24e-e131724a93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:38.407368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 646/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:04:38.459171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907c43-2487-4827-8f68-ae9f27fcbe16 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:38.459361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907c43-2487-4827-8f68-ae9f27fcbe16 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:38.459645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7907c43-2487-4827-8f68-ae9f27fcbe16 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:38.461304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 663/1309] 10.222.0.43 () {54 vars in 964 bytes} [Thu Jun 16 21:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:38.475486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdab59b-633e-4823-a16e-b1b581355c9d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:38.476009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdab59b-633e-4823-a16e-b1b581355c9d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:38.476535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdab59b-633e-4823-a16e-b1b581355c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:38.573383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5cdab59b-633e-4823-a16e-b1b581355c9d None None] MFA Rules not processed for user `d9ea56567eeb4392b5f9e5c84f16f413`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:38.574889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5cdab59b-633e-4823-a16e-b1b581355c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:38.599653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:38.660748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 647/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Jun 16 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:38.669545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907c43-2487-4827-8f68-ae9f27fcbe16 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:04:38.671830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b7907c43-2487-4827-8f68-ae9f27fcbe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:38.792257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7907c43-2487-4827-8f68-ae9f27fcbe16 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:04:38.874590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc235e3-4e24-4b3d-ab7d-7375f00834e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:04:38.875345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc235e3-4e24-4b3d-ab7d-7375f00834e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:38.875627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc235e3-4e24-4b3d-ab7d-7375f00834e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:38.875895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc235e3-4e24-4b3d-ab7d-7375f00834e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:38.877541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2dc235e3-4e24-4b3d-ab7d-7375f00834e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:38.950404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:39.045130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc235e3-4e24-4b3d-ab7d-7375f00834e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:04:39.047825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc235e3-4e24-4b3d-ab7d-7375f00834e2 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:04:39.084343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 664/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:04:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:04:41.594793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9becaca-6557-4eb6-a45c-42e1458cc3db None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:41.595321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9becaca-6557-4eb6-a45c-42e1458cc3db None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:41.595429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9becaca-6557-4eb6-a45c-42e1458cc3db None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:41.596774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 648/1312] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:41.601973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e1abb-23c1-42a2-a1ea-58b3e278c4d5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:41.602386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e1abb-23c1-42a2-a1ea-58b3e278c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:41.602559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e1abb-23c1-42a2-a1ea-58b3e278c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:41.696287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d37e1abb-23c1-42a2-a1ea-58b3e278c4d5 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:41.697513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d37e1abb-23c1-42a2-a1ea-58b3e278c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:41.810901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 665/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:41.864488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec68bdb-f5cd-414d-be38-e383a389d0c5 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:41.864804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec68bdb-f5cd-414d-be38-e383a389d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:41.865085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec68bdb-f5cd-414d-be38-e383a389d0c5 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:41.866561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 649/1314] 10.222.0.43 () {54 vars in 964 bytes} [Thu Jun 16 21:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:41.872796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ae7c-4a97-497a-9112-0ef046f1b0f5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:41.873626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ae7c-4a97-497a-9112-0ef046f1b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:41.874311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0ae7c-4a97-497a-9112-0ef046f1b0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:41.885073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:41.955937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-49e0ae7c-4a97-497a-9112-0ef046f1b0f5 None None] MFA Rules not processed for user `d9ea56567eeb4392b5f9e5c84f16f413`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:41.957205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-49e0ae7c-4a97-497a-9112-0ef046f1b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:42.035378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 666/1315] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Jun 16 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:42.044313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec68bdb-f5cd-414d-be38-e383a389d0c5 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:04:42.046466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6ec68bdb-f5cd-414d-be38-e383a389d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:42.148501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec68bdb-f5cd-414d-be38-e383a389d0c5 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:04:42.227229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:42.229876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b72403-111a-4e33-b5a3-e079607bf80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:04:42.230542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72403-111a-4e33-b5a3-e079607bf80c service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:42.231156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72403-111a-4e33-b5a3-e079607bf80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:42.232037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b72403-111a-4e33-b5a3-e079607bf80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:42.234875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e5b72403-111a-4e33-b5a3-e079607bf80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:42.343267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b72403-111a-4e33-b5a3-e079607bf80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:04:42.344741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b72403-111a-4e33-b5a3-e079607bf80c service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:04:42.363155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 650/1316] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:04:45.024734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a84a19-fe8f-4f89-a79b-db7e059f80a8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:45.025313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a84a19-fe8f-4f89-a79b-db7e059f80a8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:45.025313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a84a19-fe8f-4f89-a79b-db7e059f80a8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:45.026589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 667/1317] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:45.032453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5245-e4ec-4b60-af5f-85175fa575fe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:45.032854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5245-e4ec-4b60-af5f-85175fa575fe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:45.033011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c5245-e4ec-4b60-af5f-85175fa575fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:45.096594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-791c5245-e4ec-4b60-af5f-85175fa575fe None None] MFA Rules not processed for user `4e3d837f340948cd83d27b91759a8878`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:45.097786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-791c5245-e4ec-4b60-af5f-85175fa575fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:45.148049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:45.191502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 651/1318] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:45.231243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a84a19-fe8f-4f89-a79b-db7e059f80a8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:04:45.233549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-74a84a19-fe8f-4f89-a79b-db7e059f80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:45.337870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a84a19-fe8f-4f89-a79b-db7e059f80a8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:04:45.340724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:45.411937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346678ed-0442-4d9f-a69a-ea2abaacc1c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:04:45.412618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346678ed-0442-4d9f-a69a-ea2abaacc1c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:45.412904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346678ed-0442-4d9f-a69a-ea2abaacc1c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:45.413183 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346678ed-0442-4d9f-a69a-ea2abaacc1c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:45.414824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-346678ed-0442-4d9f-a69a-ea2abaacc1c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:45.521708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346678ed-0442-4d9f-a69a-ea2abaacc1c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:04:45.523134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346678ed-0442-4d9f-a69a-ea2abaacc1c7 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:04:45.541224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 668/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:04:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:04:48.199574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e658c82-9829-4508-996b-0afb8f876c31 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:48.200145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e658c82-9829-4508-996b-0afb8f876c31 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:48.200145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e658c82-9829-4508-996b-0afb8f876c31 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:48.201804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 652/1320] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:48.206803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6185f7-daac-4860-a326-42b1ba7ce937 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:48.207237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6185f7-daac-4860-a326-42b1ba7ce937 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:48.207369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6185f7-daac-4860-a326-42b1ba7ce937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:48.247090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:48.272728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-be6185f7-daac-4860-a326-42b1ba7ce937 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:48.273921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-be6185f7-daac-4860-a326-42b1ba7ce937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:48.370614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 669/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:48 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:48.410590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e658c82-9829-4508-996b-0afb8f876c31 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:04:48.412110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0e658c82-9829-4508-996b-0afb8f876c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:48.514517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e658c82-9829-4508-996b-0afb8f876c31 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:04:48.586511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd685ae2-8769-4559-88b1-af187a4ad850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:04:48.587148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685ae2-8769-4559-88b1-af187a4ad850 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:48.587427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685ae2-8769-4559-88b1-af187a4ad850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:48.587700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685ae2-8769-4559-88b1-af187a4ad850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:48.589355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bd685ae2-8769-4559-88b1-af187a4ad850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:48.597802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:48.698357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd685ae2-8769-4559-88b1-af187a4ad850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:04:48.699805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd685ae2-8769-4559-88b1-af187a4ad850 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:04:48.718042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 653/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:04:48 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:04:51.547022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565eaee-8cd1-4e5d-8e2a-52a2aeff3a36 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:51.547589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565eaee-8cd1-4e5d-8e2a-52a2aeff3a36 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:51.547685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565eaee-8cd1-4e5d-8e2a-52a2aeff3a36 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:51.549105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 670/1323] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:51.554973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66d5f-c06b-4028-a350-bca7f8ffd5cf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:51.555527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66d5f-c06b-4028-a350-bca7f8ffd5cf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:51.555527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da66d5f-c06b-4028-a350-bca7f8ffd5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:51.634238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6da66d5f-c06b-4028-a350-bca7f8ffd5cf None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:51.635479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6da66d5f-c06b-4028-a350-bca7f8ffd5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:51.697607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:51.741408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 654/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:51.778352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565eaee-8cd1-4e5d-8e2a-52a2aeff3a36 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:04:51.783408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a565eaee-8cd1-4e5d-8e2a-52a2aeff3a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:51.886637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565eaee-8cd1-4e5d-8e2a-52a2aeff3a36 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:04:51.899241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:51.960676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958165ae-dcef-497c-8eb4-82aab2b29899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:04:51.961241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958165ae-dcef-497c-8eb4-82aab2b29899 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:51.961530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958165ae-dcef-497c-8eb4-82aab2b29899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:51.961814 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958165ae-dcef-497c-8eb4-82aab2b29899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:51.963473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-958165ae-dcef-497c-8eb4-82aab2b29899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:52.072667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958165ae-dcef-497c-8eb4-82aab2b29899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:04:52.074109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958165ae-dcef-497c-8eb4-82aab2b29899 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:04:52.091887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 671/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:04:54.291661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb4dc-60b7-4e44-9032-574383bd9c16 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:54.292311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb4dc-60b7-4e44-9032-574383bd9c16 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:54.292311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb4dc-60b7-4e44-9032-574383bd9c16 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:54.293638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 655/1326] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:54.299558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a0f8-aae3-4635-a23d-56a3af18bdf8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:54.299979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a0f8-aae3-4635-a23d-56a3af18bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:54.300217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7a0f8-aae3-4635-a23d-56a3af18bdf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:54.349433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:54.368899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-85c7a0f8-aae3-4635-a23d-56a3af18bdf8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:54.370098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-85c7a0f8-aae3-4635-a23d-56a3af18bdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:54.468188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 672/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:54.505129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb4dc-60b7-4e44-9032-574383bd9c16 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:04:54.507639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f1bbb4dc-60b7-4e44-9032-574383bd9c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:54.620311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb4dc-60b7-4e44-9032-574383bd9c16 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:04:54.696710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787977d-2b6d-4473-8b3c-34a65f58d3e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:04:54.697361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787977d-2b6d-4473-8b3c-34a65f58d3e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:54.697642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787977d-2b6d-4473-8b3c-34a65f58d3e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:54.697915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787977d-2b6d-4473-8b3c-34a65f58d3e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:54.699550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2787977d-2b6d-4473-8b3c-34a65f58d3e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:54.716935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:54.834182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787977d-2b6d-4473-8b3c-34a65f58d3e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:04:54.835880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787977d-2b6d-4473-8b3c-34a65f58d3e1 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:04:54.857958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 656/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:04:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:04:57.076675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4fa7e-09ef-4dfe-b152-48cef1cb8a62 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:57.077234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4fa7e-09ef-4dfe-b152-48cef1cb8a62 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:57.077234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d4fa7e-09ef-4dfe-b152-48cef1cb8a62 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:57.078615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 673/1329] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:57.083738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05f58f-072a-42b2-8eaf-305d218181cc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:57.084164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05f58f-072a-42b2-8eaf-305d218181cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:57.084469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05f58f-072a-42b2-8eaf-305d218181cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:57.151509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0f05f58f-072a-42b2-8eaf-305d218181cc None None] MFA Rules not processed for user `4e3d837f340948cd83d27b91759a8878`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:04:57.152783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0f05f58f-072a-42b2-8eaf-305d218181cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:57.218204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:57.250797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 657/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:04:57.288458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4fa7e-09ef-4dfe-b152-48cef1cb8a62 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:04:57.290021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-68d4fa7e-09ef-4dfe-b152-48cef1cb8a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:57.418209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d4fa7e-09ef-4dfe-b152-48cef1cb8a62 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:04:57.440151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:04:57.495259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a42cc-c248-4d68-a194-146a09fc6eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:04:57.495903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a42cc-c248-4d68-a194-146a09fc6eba service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:57.496204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a42cc-c248-4d68-a194-146a09fc6eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:57.496484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a42cc-c248-4d68-a194-146a09fc6eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:57.498710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7e9a42cc-c248-4d68-a194-146a09fc6eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:04:57.606968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a42cc-c248-4d68-a194-146a09fc6eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:04:57.609380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a42cc-c248-4d68-a194-146a09fc6eba service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:04:57.628281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 674/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:04:59.991554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f10d1-1b74-4f77-8fe4-a049b2af0f82 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:59.992069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f10d1-1b74-4f77-8fe4-a049b2af0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:59.992069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f10d1-1b74-4f77-8fe4-a049b2af0f82 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:04:59.993441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 658/1332] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:04:59.999190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90df84-22bb-4aa4-ae43-7c456f67bc19 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:04:59.999623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90df84-22bb-4aa4-ae43-7c456f67bc19 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:04:59.999749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90df84-22bb-4aa4-ae43-7c456f67bc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:00.059552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:00.063394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4e90df84-22bb-4aa4-ae43-7c456f67bc19 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:00.064937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4e90df84-22bb-4aa4-ae43-7c456f67bc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:00.160124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 675/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:00.197927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f10d1-1b74-4f77-8fe4-a049b2af0f82 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:00.199480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-da9f10d1-1b74-4f77-8fe4-a049b2af0f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:00.305586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f10d1-1b74-4f77-8fe4-a049b2af0f82 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:00.381093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb100d0-d36c-41bf-98b4-2ecdfedf15ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:00.381737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb100d0-d36c-41bf-98b4-2ecdfedf15ab service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:00.382016 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb100d0-d36c-41bf-98b4-2ecdfedf15ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:00.382287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb100d0-d36c-41bf-98b4-2ecdfedf15ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:00.383951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4eb100d0-d36c-41bf-98b4-2ecdfedf15ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:00.411821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:00.495357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb100d0-d36c-41bf-98b4-2ecdfedf15ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:00.496764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb100d0-d36c-41bf-98b4-2ecdfedf15ab service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:00.515440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 659/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:02.684277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea4eeb-ec2f-4f3c-b4f0-ab7604da7b3c None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:02.684877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea4eeb-ec2f-4f3c-b4f0-ab7604da7b3c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:02.684877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea4eeb-ec2f-4f3c-b4f0-ab7604da7b3c None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:02.686404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 676/1335] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:02.692312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2556748-9bac-4ffe-931f-c22b6e7c04d7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:02.692756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2556748-9bac-4ffe-931f-c22b6e7c04d7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:02.692852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2556748-9bac-4ffe-931f-c22b6e7c04d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:02.756746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b2556748-9bac-4ffe-931f-c22b6e7c04d7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:02.757929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b2556748-9bac-4ffe-931f-c22b6e7c04d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:02.832418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:02.855109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 660/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:02.895791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea4eeb-ec2f-4f3c-b4f0-ab7604da7b3c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:02.897394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ffea4eeb-ec2f-4f3c-b4f0-ab7604da7b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:03.002279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea4eeb-ec2f-4f3c-b4f0-ab7604da7b3c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:03.031053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:03.075876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6a883-8176-4e67-a1e9-fdeb15e933f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:03.077077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a883-8176-4e67-a1e9-fdeb15e933f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:03.077368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a883-8176-4e67-a1e9-fdeb15e933f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:03.077641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6a883-8176-4e67-a1e9-fdeb15e933f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:03.079280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1ad6a883-8176-4e67-a1e9-fdeb15e933f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:03.191359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6a883-8176-4e67-a1e9-fdeb15e933f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:03.192787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6a883-8176-4e67-a1e9-fdeb15e933f3 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:03.211285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 677/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:05.666285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952d6f-dbe5-4e7d-a087-77ca650e2c51 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:05.673458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952d6f-dbe5-4e7d-a087-77ca650e2c51 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:05.673458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952d6f-dbe5-4e7d-a087-77ca650e2c51 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:05.673458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 661/1338] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:05.675458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e252ed-4896-4818-9fc3-a8870d4f79a8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:05.675903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e252ed-4896-4818-9fc3-a8870d4f79a8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:05.676015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e252ed-4896-4818-9fc3-a8870d4f79a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:05.740367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-09e252ed-4896-4818-9fc3-a8870d4f79a8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:05.741558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-09e252ed-4896-4818-9fc3-a8870d4f79a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:05.750214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:05.838453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 678/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:05.875551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9952d6f-dbe5-4e7d-a087-77ca650e2c51 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:05.877109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a9952d6f-dbe5-4e7d-a087-77ca650e2c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:05.977824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9952d6f-dbe5-4e7d-a087-77ca650e2c51 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:06.048761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548176ee-3a85-422b-823f-9839583c917b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:06.049398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548176ee-3a85-422b-823f-9839583c917b service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:06.049678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548176ee-3a85-422b-823f-9839583c917b service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:06.049947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548176ee-3a85-422b-823f-9839583c917b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:06.051554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-548176ee-3a85-422b-823f-9839583c917b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:06.085403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:06.163102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548176ee-3a85-422b-823f-9839583c917b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:06.164494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548176ee-3a85-422b-823f-9839583c917b service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:06.181817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 662/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:10.627797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10ac5-f3dd-4da6-9ed7-5202ee8e2edc None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:10.628541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10ac5-f3dd-4da6-9ed7-5202ee8e2edc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:10.628541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c10ac5-f3dd-4da6-9ed7-5202ee8e2edc None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:10.629886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 679/1341] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:10.635294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd562b8-9a17-4e3c-8416-3dcee7f1027b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:10.635681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd562b8-9a17-4e3c-8416-3dcee7f1027b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:10.635784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd562b8-9a17-4e3c-8416-3dcee7f1027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:10.709024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6cd562b8-9a17-4e3c-8416-3dcee7f1027b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:10.710152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6cd562b8-9a17-4e3c-8416-3dcee7f1027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:10.804691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:10.818123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 663/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:10.857039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c10ac5-f3dd-4da6-9ed7-5202ee8e2edc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:10.859912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d7c10ac5-f3dd-4da6-9ed7-5202ee8e2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:10.957427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c10ac5-f3dd-4da6-9ed7-5202ee8e2edc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:10.960938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d7a31-78d1-4128-973a-6547f31abc29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:10.961587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d7a31-78d1-4128-973a-6547f31abc29 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:10.961870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d7a31-78d1-4128-973a-6547f31abc29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:10.962145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d7a31-78d1-4128-973a-6547f31abc29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:10.971269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d7a31-78d1-4128-973a-6547f31abc29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:10.972771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d7a31-78d1-4128-973a-6547f31abc29 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:10.982157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 680/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:13.757277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecb346-61a7-40fd-96a5-9b1bf7ac2b84 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:13.757896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecb346-61a7-40fd-96a5-9b1bf7ac2b84 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:13.757896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecb346-61a7-40fd-96a5-9b1bf7ac2b84 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:13.759257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 664/1344] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:05:13.765757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a118-f4ef-4f4e-8293-215f21358158 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:13.766332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a118-f4ef-4f4e-8293-215f21358158 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:13.766332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323a118-f4ef-4f4e-8293-215f21358158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:13.799191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4323a118-f4ef-4f4e-8293-215f21358158 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:13.800354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4323a118-f4ef-4f4e-8293-215f21358158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:13.830748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:13.882386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 681/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:13.920281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecb346-61a7-40fd-96a5-9b1bf7ac2b84 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:13.931161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecb346-61a7-40fd-96a5-9b1bf7ac2b84 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:13.934831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1d9a5-46ec-4996-b4fc-e1bcdb293f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:13.935571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d9a5-46ec-4996-b4fc-e1bcdb293f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:13.935912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d9a5-46ec-4996-b4fc-e1bcdb293f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:13.936293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1d9a5-46ec-4996-b4fc-e1bcdb293f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:13.946370 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d9a5-46ec-4996-b4fc-e1bcdb293f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:13.947899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1d9a5-46ec-4996-b4fc-e1bcdb293f5e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:13.958766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 665/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:18.039111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f3a44-a4ef-4544-8f3d-67c23b74ce51 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:18.039686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f3a44-a4ef-4544-8f3d-67c23b74ce51 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:18.039686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f3a44-a4ef-4544-8f3d-67c23b74ce51 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:18.041089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 682/1347] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:05:18.046405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c44a83-bda5-4675-9d2a-b51dd1f2d1bc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:18.046851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c44a83-bda5-4675-9d2a-b51dd1f2d1bc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:18.046966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c44a83-bda5-4675-9d2a-b51dd1f2d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:18.069741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-34c44a83-bda5-4675-9d2a-b51dd1f2d1bc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:18.070963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-34c44a83-bda5-4675-9d2a-b51dd1f2d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:18.079634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 666/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:18.117380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f3a44-a4ef-4544-8f3d-67c23b74ce51 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:18.119126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-aa8f3a44-a4ef-4544-8f3d-67c23b74ce51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:18.132450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f3a44-a4ef-4544-8f3d-67c23b74ce51 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:18.136440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4c361-ee90-41a3-a82b-fda672c97f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:18.137084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4c361-ee90-41a3-a82b-fda672c97f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:18.137369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4c361-ee90-41a3-a82b-fda672c97f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:18.137648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4c361-ee90-41a3-a82b-fda672c97f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:18.147452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4c361-ee90-41a3-a82b-fda672c97f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:18.148928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4c361-ee90-41a3-a82b-fda672c97f7e service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:18.158545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 683/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:23.374450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971c62-a37b-4f15-bacb-1262159ce31c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:23.396693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971c62-a37b-4f15-bacb-1262159ce31c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:23.396979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3971c62-a37b-4f15-bacb-1262159ce31c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:23.398391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 667/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:05:23 2022] GET /identity => generated 270 bytes in 26 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:23.407558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda6985-5d2c-4f43-ae8b-ced3e23325c6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:23.407997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda6985-5d2c-4f43-ae8b-ced3e23325c6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:23.408080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda6985-5d2c-4f43-ae8b-ced3e23325c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:23.539979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6bda6985-5d2c-4f43-ae8b-ced3e23325c6 None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:23.541245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6bda6985-5d2c-4f43-ae8b-ced3e23325c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:23.621753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 684/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:05:27.956673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6c75-0d41-4ce9-906a-4a8e401f9841 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:27.957176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6c75-0d41-4ce9-906a-4a8e401f9841 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:27.957447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf6c75-0d41-4ce9-906a-4a8e401f9841 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:27.959126 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 668/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:27.964495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58443c-e5cd-4a14-a13f-c2b66ff0d01c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:27.965065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58443c-e5cd-4a14-a13f-c2b66ff0d01c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:27.965065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58443c-e5cd-4a14-a13f-c2b66ff0d01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:27.984525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4f58443c-e5cd-4a14-a13f-c2b66ff0d01c None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:27.985735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4f58443c-e5cd-4a14-a13f-c2b66ff0d01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:27.994357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 685/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:05:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:28.063097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=13 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:29.391686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadb32-54aa-492b-8527-f012fed248c0 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:29.392383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadb32-54aa-492b-8527-f012fed248c0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:29.392383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acadb32-54aa-492b-8527-f012fed248c0 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:29.393779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 669/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:29.398861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824104-cc3b-4627-98a9-3816b598c684 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:29.399291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824104-cc3b-4627-98a9-3816b598c684 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:29.399410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65824104-cc3b-4627-98a9-3816b598c684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:29.417575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-65824104-cc3b-4627-98a9-3816b598c684 None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:29.418770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-65824104-cc3b-4627-98a9-3816b598c684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:29.428396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 686/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:33.230108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4fd4-00f6-4d86-b107-f3652e1f157c None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:33.230644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4fd4-00f6-4d86-b107-f3652e1f157c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:33.230922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4fd4-00f6-4d86-b107-f3652e1f157c None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:33.233242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 670/1356] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:33.239055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444356-6783-429c-959e-2edc739b3bd8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:33.239525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444356-6783-429c-959e-2edc739b3bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:33.239637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e444356-6783-429c-959e-2edc739b3bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:33.259373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9e444356-6783-429c-959e-2edc739b3bd8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:33.260697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9e444356-6783-429c-959e-2edc739b3bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:33.269869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 687/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:33.323543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e820-ab1f-48d0-937d-f81026e9a70f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:33.324070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e820-ab1f-48d0-937d-f81026e9a70f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:33.324583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6e820-ab1f-48d0-937d-f81026e9a70f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:33.327062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 671/1358] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 16 21:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:33.336975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d806-1839-46d6-9c50-de2e4968f509 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:33.337539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d806-1839-46d6-9c50-de2e4968f509 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:33.338331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654d806-1839-46d6-9c50-de2e4968f509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:33.388583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:33.399467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3654d806-1839-46d6-9c50-de2e4968f509 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:33.401029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3654d806-1839-46d6-9c50-de2e4968f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:33.492230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 688/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 16 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:33.500682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6e820-ab1f-48d0-937d-f81026e9a70f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:33.515044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6e820-ab1f-48d0-937d-f81026e9a70f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:33.520449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e9415-cf46-438b-b0c9-933d0bb7301d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:33.521095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e9415-cf46-438b-b0c9-933d0bb7301d service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:33.521379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e9415-cf46-438b-b0c9-933d0bb7301d service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:33.521658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e9415-cf46-438b-b0c9-933d0bb7301d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:33.531060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e9415-cf46-438b-b0c9-933d0bb7301d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:33.532856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e9415-cf46-438b-b0c9-933d0bb7301d service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:33.543009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 672/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:35.987384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678037-13d7-4a5f-a6da-f7617bef1181 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:35.987945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678037-13d7-4a5f-a6da-f7617bef1181 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:35.987945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59678037-13d7-4a5f-a6da-f7617bef1181 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:35.989626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 689/1361] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:35.994882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0ace-884a-45bb-a2d3-10ecedc8f2ce None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:35.995383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0ace-884a-45bb-a2d3-10ecedc8f2ce None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:35.995640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a0ace-884a-45bb-a2d3-10ecedc8f2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:36.016481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b10a0ace-884a-45bb-a2d3-10ecedc8f2ce None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:36.017868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b10a0ace-884a-45bb-a2d3-10ecedc8f2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:36.026578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 673/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:36.074480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59678037-13d7-4a5f-a6da-f7617bef1181 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:36.090588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59678037-13d7-4a5f-a6da-f7617bef1181 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:36.096213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfd64c-7d4f-4d9b-b0d6-790c412dba0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:36.096857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd64c-7d4f-4d9b-b0d6-790c412dba0f service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:36.097135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd64c-7d4f-4d9b-b0d6-790c412dba0f service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:36.097407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfd64c-7d4f-4d9b-b0d6-790c412dba0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:36.107845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfd64c-7d4f-4d9b-b0d6-790c412dba0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:36.109612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfd64c-7d4f-4d9b-b0d6-790c412dba0f service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:36.120947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 690/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:38.644898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ab33f-2959-491f-8f15-08a42479301f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:38.645399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ab33f-2959-491f-8f15-08a42479301f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:38.645527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ab33f-2959-491f-8f15-08a42479301f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:38.647031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 674/1364] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:38.653463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a229cd-39b9-4e15-9461-1eee527e9a74 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:38.654336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a229cd-39b9-4e15-9461-1eee527e9a74 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:38.654644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a229cd-39b9-4e15-9461-1eee527e9a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:38.674040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-23a229cd-39b9-4e15-9461-1eee527e9a74 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:38.675172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-23a229cd-39b9-4e15-9461-1eee527e9a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:38.683014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 691/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:38.729978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2dcdb-85b4-4281-95b6-725136fbcb23 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:38.730678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2dcdb-85b4-4281-95b6-725136fbcb23 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:38.731183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2dcdb-85b4-4281-95b6-725136fbcb23 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:38.733333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 675/1366] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 16 21:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:38.738669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736568-19c2-451b-9c48-7eec62d87b21 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:38.738965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736568-19c2-451b-9c48-7eec62d87b21 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:38.739247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1736568-19c2-451b-9c48-7eec62d87b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:38.758924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e1736568-19c2-451b-9c48-7eec62d87b21 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:38.760127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e1736568-19c2-451b-9c48-7eec62d87b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:38.770165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 692/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 16 21:05:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:38.779034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2dcdb-85b4-4281-95b6-725136fbcb23 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:38.797240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2dcdb-85b4-4281-95b6-725136fbcb23 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:38.802628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ac39c-cac1-4a1a-ab8e-dbc1a940148b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:38.803260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ac39c-cac1-4a1a-ab8e-dbc1a940148b service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:38.803542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ac39c-cac1-4a1a-ab8e-dbc1a940148b service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:38.803813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ac39c-cac1-4a1a-ab8e-dbc1a940148b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:38.814746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ac39c-cac1-4a1a-ab8e-dbc1a940148b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:38.816357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ac39c-cac1-4a1a-ab8e-dbc1a940148b service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:38.829220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 676/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:41.239871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627a23-0082-4371-a9f8-ece50ffe1fb2 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:41.240444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627a23-0082-4371-a9f8-ece50ffe1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:41.240444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627a23-0082-4371-a9f8-ece50ffe1fb2 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:41.241846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 693/1369] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:41.247784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96137c64-9016-4857-ad87-6d1d59f24113 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:41.248640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96137c64-9016-4857-ad87-6d1d59f24113 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:41.249173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96137c64-9016-4857-ad87-6d1d59f24113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:41.267421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-96137c64-9016-4857-ad87-6d1d59f24113 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:41.268903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-96137c64-9016-4857-ad87-6d1d59f24113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:41.277066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 677/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:41.322528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627a23-0082-4371-a9f8-ece50ffe1fb2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:41.339202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627a23-0082-4371-a9f8-ece50ffe1fb2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:41.344893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcac2b0-cff1-4804-8d6e-2283e2ecd13c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:41.345550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcac2b0-cff1-4804-8d6e-2283e2ecd13c service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:41.346011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcac2b0-cff1-4804-8d6e-2283e2ecd13c service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:41.346451 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcac2b0-cff1-4804-8d6e-2283e2ecd13c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:41.355692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcac2b0-cff1-4804-8d6e-2283e2ecd13c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:41.357768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcac2b0-cff1-4804-8d6e-2283e2ecd13c service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:41.368219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 694/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:41.700410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a839b-2147-43d7-9690-c1bc8d1f120a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:41.700700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a839b-2147-43d7-9690-c1bc8d1f120a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:41.701232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a839b-2147-43d7-9690-c1bc8d1f120a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:41.706310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 678/1372] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:41.708126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714fb7-1736-41d7-9276-0d03efc675e2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:41.708447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714fb7-1736-41d7-9276-0d03efc675e2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:41.708722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07714fb7-1736-41d7-9276-0d03efc675e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:41.726554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-07714fb7-1736-41d7-9276-0d03efc675e2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:41.727747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-07714fb7-1736-41d7-9276-0d03efc675e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:41.736688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 695/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:42.040801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968dd1-0722-4d1a-8e3e-74caf4c9002f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:42.040801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968dd1-0722-4d1a-8e3e-74caf4c9002f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:42.040801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1968dd1-0722-4d1a-8e3e-74caf4c9002f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:42.043679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 679/1374] 10.222.0.43 () {54 vars in 963 bytes} [Thu Jun 16 21:05:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:42.049364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff7fb-09b0-4fe6-a04b-fa02bd6c9f35 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:42.049734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff7fb-09b0-4fe6-a04b-fa02bd6c9f35 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:42.050141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff7fb-09b0-4fe6-a04b-fa02bd6c9f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:42.101271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b79ff7fb-09b0-4fe6-a04b-fa02bd6c9f35 None None] MFA Rules not processed for user `35b6a283856448d9aca6f50a3d58742f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:42.102580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b79ff7fb-09b0-4fe6-a04b-fa02bd6c9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:42.168674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 696/1375] 10.222.0.43 () {58 vars in 1060 bytes} [Thu Jun 16 21:05:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:42.176589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1968dd1-0722-4d1a-8e3e-74caf4c9002f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:42.188113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1968dd1-0722-4d1a-8e3e-74caf4c9002f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:42.191728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ab508-836a-45ff-b347-c39441ca79b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:42.192641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab508-836a-45ff-b347-c39441ca79b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:42.193024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab508-836a-45ff-b347-c39441ca79b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:42.193402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ab508-836a-45ff-b347-c39441ca79b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:42.203226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ab508-836a-45ff-b347-c39441ca79b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:42.204831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ab508-836a-45ff-b347-c39441ca79b9 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:42.217639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 680/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:43.559314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f768-6f3e-4eb8-bb32-4db198fb8da7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:43.560405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f768-6f3e-4eb8-bb32-4db198fb8da7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:43.560405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2f768-6f3e-4eb8-bb32-4db198fb8da7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:43.561452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 697/1377] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:43.566455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f216e-eeb0-4f63-87d1-6900483ad015 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:43.566853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f216e-eeb0-4f63-87d1-6900483ad015 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:43.567019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f216e-eeb0-4f63-87d1-6900483ad015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:43.585376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6c3f216e-eeb0-4f63-87d1-6900483ad015 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:43.586584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6c3f216e-eeb0-4f63-87d1-6900483ad015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:43.601943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 681/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:43.643850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2f768-6f3e-4eb8-bb32-4db198fb8da7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:43.658856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b2f768-6f3e-4eb8-bb32-4db198fb8da7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:43.665795 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34254e3b-6d05-4ed3-a32d-6d28005ea112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:43.666445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254e3b-6d05-4ed3-a32d-6d28005ea112 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:43.666733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254e3b-6d05-4ed3-a32d-6d28005ea112 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:43.667010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34254e3b-6d05-4ed3-a32d-6d28005ea112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:43.683241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254e3b-6d05-4ed3-a32d-6d28005ea112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:43.685119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34254e3b-6d05-4ed3-a32d-6d28005ea112 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:43.689650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:43.697145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 698/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:45.910175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314986a-28a0-432c-b0c1-54e099b03013 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:45.910740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314986a-28a0-432c-b0c1-54e099b03013 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:45.910906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314986a-28a0-432c-b0c1-54e099b03013 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:45.912557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 682/1380] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:45.917791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb29d0-367d-44ee-9f1d-c88639f18e0e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:45.918735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb29d0-367d-44ee-9f1d-c88639f18e0e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:45.919054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb29d0-367d-44ee-9f1d-c88639f18e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:45.938506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-08bb29d0-367d-44ee-9f1d-c88639f18e0e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:45.939720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-08bb29d0-367d-44ee-9f1d-c88639f18e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:45.949643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 699/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:05:46.006574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314986a-28a0-432c-b0c1-54e099b03013 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:46.021182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314986a-28a0-432c-b0c1-54e099b03013 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:46.026676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d39f2-33e7-4c3e-bd24-1746d740b771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:46.027449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d39f2-33e7-4c3e-bd24-1746d740b771 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:46.027867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d39f2-33e7-4c3e-bd24-1746d740b771 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:46.028344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d39f2-33e7-4c3e-bd24-1746d740b771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:46.036832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d39f2-33e7-4c3e-bd24-1746d740b771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:46.038514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d39f2-33e7-4c3e-bd24-1746d740b771 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:46.049390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 683/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:48.249862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098e094-9102-4bcb-aabc-a5427008b951 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:48.250410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098e094-9102-4bcb-aabc-a5427008b951 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:48.250410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098e094-9102-4bcb-aabc-a5427008b951 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:48.251788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 700/1383] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:48.257265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a0139-2a28-4e5b-bfb1-ab09d1222756 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:48.257704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a0139-2a28-4e5b-bfb1-ab09d1222756 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:48.258323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a0139-2a28-4e5b-bfb1-ab09d1222756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:48.279413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6a7a0139-2a28-4e5b-bfb1-ab09d1222756 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:48.280878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6a7a0139-2a28-4e5b-bfb1-ab09d1222756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:48.289338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 684/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:48.333134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098e094-9102-4bcb-aabc-a5427008b951 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:48.351375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098e094-9102-4bcb-aabc-a5427008b951 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:48.357768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d29003-4a1c-4a34-88b4-0e4c997f47e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:48.358421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29003-4a1c-4a34-88b4-0e4c997f47e1 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:48.358709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29003-4a1c-4a34-88b4-0e4c997f47e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:48.359272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d29003-4a1c-4a34-88b4-0e4c997f47e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:48.368297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d29003-4a1c-4a34-88b4-0e4c997f47e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:48.369876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d29003-4a1c-4a34-88b4-0e4c997f47e1 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:48.380134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 701/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:50.589413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d615d-5e66-4931-b9c5-aa899c116083 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:50.590046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d615d-5e66-4931-b9c5-aa899c116083 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:50.590802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d615d-5e66-4931-b9c5-aa899c116083 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:50.592706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 685/1386] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:50.598613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62edb2-3e28-4e34-b92c-694a72698704 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:50.599209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62edb2-3e28-4e34-b92c-694a72698704 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:50.599209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62edb2-3e28-4e34-b92c-694a72698704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:50.619491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bd62edb2-3e28-4e34-b92c-694a72698704 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:50.620766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bd62edb2-3e28-4e34-b92c-694a72698704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:50.629427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 702/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:50.673902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d615d-5e66-4931-b9c5-aa899c116083 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:50.698127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d615d-5e66-4931-b9c5-aa899c116083 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:50.708019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab5a4f-523e-4967-8921-3879814faca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:50.709231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5a4f-523e-4967-8921-3879814faca4 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:50.709760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5a4f-523e-4967-8921-3879814faca4 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:50.710299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab5a4f-523e-4967-8921-3879814faca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:50.726584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5a4f-523e-4967-8921-3879814faca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:50.729850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab5a4f-523e-4967-8921-3879814faca4 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:50.750679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 686/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:52.911686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63651e-0122-4a8f-8ff8-d3a4339b8068 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:52.912239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63651e-0122-4a8f-8ff8-d3a4339b8068 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:52.912239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63651e-0122-4a8f-8ff8-d3a4339b8068 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:52.913645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 703/1389] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:52.919589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6428-3c76-49f1-9d83-d9d3ff55c633 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:52.920040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6428-3c76-49f1-9d83-d9d3ff55c633 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:52.920203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb6428-3c76-49f1-9d83-d9d3ff55c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:52.941996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-badb6428-3c76-49f1-9d83-d9d3ff55c633 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:52.943526 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-badb6428-3c76-49f1-9d83-d9d3ff55c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:52.954498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 687/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:53.000378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63651e-0122-4a8f-8ff8-d3a4339b8068 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:53.022420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63651e-0122-4a8f-8ff8-d3a4339b8068 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:53.030003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b5b85-0e82-4389-aa9b-849e8dd16706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:53.030857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b5b85-0e82-4389-aa9b-849e8dd16706 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:53.031321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b5b85-0e82-4389-aa9b-849e8dd16706 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:53.031705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b5b85-0e82-4389-aa9b-849e8dd16706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:53.044624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b5b85-0e82-4389-aa9b-849e8dd16706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:53.046318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b5b85-0e82-4389-aa9b-849e8dd16706 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:53.056847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 704/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:55.352419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130e5a-e900-4f87-84af-05449455541e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:55.353190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130e5a-e900-4f87-84af-05449455541e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:55.353190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130e5a-e900-4f87-84af-05449455541e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:55.354455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 688/1392] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:55.360356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbb691-3b2f-4bde-82d5-3a29cd215d8d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:55.360820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbb691-3b2f-4bde-82d5-3a29cd215d8d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:55.360947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbb691-3b2f-4bde-82d5-3a29cd215d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:55.379595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2cfbb691-3b2f-4bde-82d5-3a29cd215d8d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:55.380841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2cfbb691-3b2f-4bde-82d5-3a29cd215d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:55.389802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 705/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:55.436158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73130e5a-e900-4f87-84af-05449455541e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:55.451788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73130e5a-e900-4f87-84af-05449455541e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:55.457345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941741ae-caa1-45c5-8596-ced1f5c40da9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:55.457985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941741ae-caa1-45c5-8596-ced1f5c40da9 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:55.458280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941741ae-caa1-45c5-8596-ced1f5c40da9 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:55.458589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941741ae-caa1-45c5-8596-ced1f5c40da9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:55.467650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941741ae-caa1-45c5-8596-ced1f5c40da9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:55.469270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941741ae-caa1-45c5-8596-ced1f5c40da9 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:55.478729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 689/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:57.624343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3de7bf-984b-4399-a40f-1973eecdd389 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.625261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3de7bf-984b-4399-a40f-1973eecdd389 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.625261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3de7bf-984b-4399-a40f-1973eecdd389 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.626277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 706/1395] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:57.631468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db381-9dcc-4290-bf5a-80964eabdd13 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.631923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db381-9dcc-4290-bf5a-80964eabdd13 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.632030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487db381-9dcc-4290-bf5a-80964eabdd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.649908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-487db381-9dcc-4290-bf5a-80964eabdd13 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:57.651143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-487db381-9dcc-4290-bf5a-80964eabdd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:57.659391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc9b6-b5d0-4148-b10b-dabd8a8e0d72 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.659677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc9b6-b5d0-4148-b10b-dabd8a8e0d72 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.659893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 690/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:57.660042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dc9b6-b5d0-4148-b10b-dabd8a8e0d72 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.661328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 707/1397] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:05:57.666144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991597bf-1edf-4535-a1c6-3428e5029aed None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.666432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991597bf-1edf-4535-a1c6-3428e5029aed None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.666737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991597bf-1edf-4535-a1c6-3428e5029aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.684606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-991597bf-1edf-4535-a1c6-3428e5029aed None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:57.685772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-991597bf-1edf-4535-a1c6-3428e5029aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:57.694520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 691/1398] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:57.717475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a94e-dcce-41e9-a393-f5afb23d3e65 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.717769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a94e-dcce-41e9-a393-f5afb23d3e65 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.718053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a94e-dcce-41e9-a393-f5afb23d3e65 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.719429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 708/1399] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jun 16 21:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:57.724715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c87c0-4276-40df-9952-bd12827eefa3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.725001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c87c0-4276-40df-9952-bd12827eefa3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.725304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c87c0-4276-40df-9952-bd12827eefa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.739237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a94e-dcce-41e9-a393-f5afb23d3e65 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:57.753886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a94e-dcce-41e9-a393-f5afb23d3e65 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:57.759416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:57.760081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.760411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.760689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.769315 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:57.770940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:57.774115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-402c87c0-4276-40df-9952-bd12827eefa3 None None] MFA Rules not processed for user `4fd5a266491c487385349368b5ccbbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:57.775323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-402c87c0-4276-40df-9952-bd12827eefa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:57.781266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 709/1400] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:05:57.837686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 692/1401] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jun 16 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:57.846169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:57.856242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2280895-4912-463c-8ffc-db3b604f4b66 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:57.860469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65d699-9ded-4085-9e53-5476dad0135e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd5a266491c487385349368b5ccbbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:57.861150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d699-9ded-4085-9e53-5476dad0135e service glance] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:57.861434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d699-9ded-4085-9e53-5476dad0135e service glance] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:57.861860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65d699-9ded-4085-9e53-5476dad0135e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:57.872613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d699-9ded-4085-9e53-5476dad0135e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:57.874079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65d699-9ded-4085-9e53-5476dad0135e service glance] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:57.884979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 710/1402] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:05:58.602774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dff0ce-799b-43ce-9c07-e8c96ad98970 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:58.603070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dff0ce-799b-43ce-9c07-e8c96ad98970 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:58.603352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dff0ce-799b-43ce-9c07-e8c96ad98970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:58.609572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:05:58.653864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-96dff0ce-799b-43ce-9c07-e8c96ad98970 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:58.655075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-96dff0ce-799b-43ce-9c07-e8c96ad98970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:58.717237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 693/1403] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:58.758940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f19de-dc75-4493-aa99-5ca56e7eabc7 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:58.759427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f19de-dc75-4493-aa99-5ca56e7eabc7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:58.759618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f19de-dc75-4493-aa99-5ca56e7eabc7 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:58.761169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 711/1404] 10.222.0.43 () {54 vars in 942 bytes} [Thu Jun 16 21:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:05:58.767921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0f6ad-e783-4e25-8f34-9fa9ead66890 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:58.768247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0f6ad-e783-4e25-8f34-9fa9ead66890 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:58.768533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0f6ad-e783-4e25-8f34-9fa9ead66890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:58.817632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d0e0f6ad-e783-4e25-8f34-9fa9ead66890 None None] MFA Rules not processed for user `759ce183ee164679ba3d16860c088804`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:05:58.818815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d0e0f6ad-e783-4e25-8f34-9fa9ead66890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:05:58.891496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 694/1405] 10.222.0.43 () {58 vars in 1039 bytes} [Thu Jun 16 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:05:58.900812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f19de-dc75-4493-aa99-5ca56e7eabc7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:05:58.914029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f19de-dc75-4493-aa99-5ca56e7eabc7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:05:58.919457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c9134-3b60-4272-8fd1-938b6ce866d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:05:58.920088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c9134-3b60-4272-8fd1-938b6ce866d2 service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:05:58.920396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c9134-3b60-4272-8fd1-938b6ce866d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:05:58.920668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c9134-3b60-4272-8fd1-938b6ce866d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:05:58.928682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c9134-3b60-4272-8fd1-938b6ce866d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:05:58.930259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c9134-3b60-4272-8fd1-938b6ce866d2 service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:05:58.939551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 712/1406] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 21:06:00.004841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869cca4-4b76-4096-835c-d51daee15f4d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:00.005395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869cca4-4b76-4096-835c-d51daee15f4d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:00.005395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869cca4-4b76-4096-835c-d51daee15f4d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:00.007011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 695/1407] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:00.012898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d600b1-91b4-44ab-8b30-0a49c877a68b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:00.013813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d600b1-91b4-44ab-8b30-0a49c877a68b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:00.014338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d600b1-91b4-44ab-8b30-0a49c877a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:00.033687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a1d600b1-91b4-44ab-8b30-0a49c877a68b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:00.034895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a1d600b1-91b4-44ab-8b30-0a49c877a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:00.043075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 713/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:00.087824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869cca4-4b76-4096-835c-d51daee15f4d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:00.105574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869cca4-4b76-4096-835c-d51daee15f4d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:00.111654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574928-0979-42e7-8fc2-ea22df4df595 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:00.112441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574928-0979-42e7-8fc2-ea22df4df595 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:00.112778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574928-0979-42e7-8fc2-ea22df4df595 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:00.113127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574928-0979-42e7-8fc2-ea22df4df595 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:00.122846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574928-0979-42e7-8fc2-ea22df4df595 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:00.124570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574928-0979-42e7-8fc2-ea22df4df595 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:00.137489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 696/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:10.028124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=43 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:06:10.132739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:06:21.534115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9f7c-a8a8-461d-8b2c-d2ff355707d8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:21.534662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9f7c-a8a8-461d-8b2c-d2ff355707d8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:21.534662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a9f7c-a8a8-461d-8b2c-d2ff355707d8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:21.536059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 714/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Jun 16 21:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:21.541240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921993d5-02ed-4e23-b798-4c76bafb3807 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:21.542204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921993d5-02ed-4e23-b798-4c76bafb3807 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:21.542498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921993d5-02ed-4e23-b798-4c76bafb3807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:21.560193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-921993d5-02ed-4e23-b798-4c76bafb3807 None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:21.561371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-921993d5-02ed-4e23-b798-4c76bafb3807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:21.569739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 697/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 16 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:21.583371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f1ca7-40c3-4774-9eb2-109b57e79e15 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:21.583660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f1ca7-40c3-4774-9eb2-109b57e79e15 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:21.583938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f1ca7-40c3-4774-9eb2-109b57e79e15 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:21.585324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 715/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Jun 16 21:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:21.590248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd53af-733f-41bb-82af-9afa99581510 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:21.590536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd53af-733f-41bb-82af-9afa99581510 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:21.590810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd53af-733f-41bb-82af-9afa99581510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:21.609817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-30dd53af-733f-41bb-82af-9afa99581510 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:21.611035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-30dd53af-733f-41bb-82af-9afa99581510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:21.620035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 698/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Jun 16 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:24.192803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3d6f-f9b2-48d9-98a5-a1f8aaf9b667 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:24.193388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3d6f-f9b2-48d9-98a5-a1f8aaf9b667 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:24.193388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3d6f-f9b2-48d9-98a5-a1f8aaf9b667 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:24.194768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:24.200061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb346-7316-425d-befb-5ecc026e9d5b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:24.200516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb346-7316-425d-befb-5ecc026e9d5b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:24.200657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb346-7316-425d-befb-5ecc026e9d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:24.218176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e9ccb346-7316-425d-befb-5ecc026e9d5b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:24.219365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e9ccb346-7316-425d-befb-5ecc026e9d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:24.227377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:24.271832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3d6f-f9b2-48d9-98a5-a1f8aaf9b667 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:24.287880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3d6f-f9b2-48d9-98a5-a1f8aaf9b667 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:24.293399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a013ede-31bc-4c42-b9b6-9ae0bac4c4d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:24.294063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013ede-31bc-4c42-b9b6-9ae0bac4c4d5 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:24.294344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013ede-31bc-4c42-b9b6-9ae0bac4c4d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:24.294620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a013ede-31bc-4c42-b9b6-9ae0bac4c4d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:24.302670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a013ede-31bc-4c42-b9b6-9ae0bac4c4d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:24.304308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a013ede-31bc-4c42-b9b6-9ae0bac4c4d5 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:24.313507 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 717/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:25.261715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38b73-3acc-4e0a-a52c-8c81ca45176e None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:25.262238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38b73-3acc-4e0a-a52c-8c81ca45176e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:25.262354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38b73-3acc-4e0a-a52c-8c81ca45176e None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:25.263642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:25.268545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda40099-2af7-4225-b5a0-179de8cb6359 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:25.268970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda40099-2af7-4225-b5a0-179de8cb6359 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:25.269131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda40099-2af7-4225-b5a0-179de8cb6359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:25.287599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-fda40099-2af7-4225-b5a0-179de8cb6359 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:25.288820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fda40099-2af7-4225-b5a0-179de8cb6359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:25.296768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:25.447588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38b73-3acc-4e0a-a52c-8c81ca45176e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:25.461622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38b73-3acc-4e0a-a52c-8c81ca45176e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:25.467396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8336f-1e07-4414-adff-166766232871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:25.468028 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8336f-1e07-4414-adff-166766232871 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:25.468342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8336f-1e07-4414-adff-166766232871 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:25.468619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8336f-1e07-4414-adff-166766232871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:25.476458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8336f-1e07-4414-adff-166766232871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:25.478029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8336f-1e07-4414-adff-166766232871 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:25.487968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 701/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:26.416505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbe171-603f-4570-b618-f0ba2736cb3a None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:26.416505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbe171-603f-4570-b618-f0ba2736cb3a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:26.417128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbe171-603f-4570-b618-f0ba2736cb3a None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:26.418132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:26.422961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90c6c-47c8-4581-af6f-1284f5cf5526 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:26.423490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90c6c-47c8-4581-af6f-1284f5cf5526 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:26.423666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90c6c-47c8-4581-af6f-1284f5cf5526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:26.441076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8ec90c6c-47c8-4581-af6f-1284f5cf5526 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:26.442253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8ec90c6c-47c8-4581-af6f-1284f5cf5526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:26.450411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:26.600137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbe171-603f-4570-b618-f0ba2736cb3a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:26.616244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbe171-603f-4570-b618-f0ba2736cb3a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:26.622732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de13310-5186-46a5-8fbf-8f5932bec1ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:26.623371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13310-5186-46a5-8fbf-8f5932bec1ec service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:26.623656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13310-5186-46a5-8fbf-8f5932bec1ec service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:26.623935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de13310-5186-46a5-8fbf-8f5932bec1ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:26.631909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13310-5186-46a5-8fbf-8f5932bec1ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:26.633552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de13310-5186-46a5-8fbf-8f5932bec1ec service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:26.643465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 720/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:27.549724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8482-82af-4977-bed8-f3bce6918118 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:27.550388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8482-82af-4977-bed8-f3bce6918118 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:27.550388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd8482-82af-4977-bed8-f3bce6918118 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:27.551701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:27.556487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634aeb-17dd-49b2-a87d-975bde70b4cc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:27.557659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634aeb-17dd-49b2-a87d-975bde70b4cc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:27.557851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5634aeb-17dd-49b2-a87d-975bde70b4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:27.577411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c5634aeb-17dd-49b2-a87d-975bde70b4cc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:27.578606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c5634aeb-17dd-49b2-a87d-975bde70b4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:27.586644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:27.736862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8482-82af-4977-bed8-f3bce6918118 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:27.751917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd8482-82af-4977-bed8-f3bce6918118 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:27.757278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96569d-f480-40eb-9676-8fe42fb5c755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:27.757911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96569d-f480-40eb-9676-8fe42fb5c755 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:27.758194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96569d-f480-40eb-9676-8fe42fb5c755 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:27.758472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96569d-f480-40eb-9676-8fe42fb5c755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:27.767607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96569d-f480-40eb-9676-8fe42fb5c755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:27.769227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96569d-f480-40eb-9676-8fe42fb5c755 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:27.779998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 704/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:28.697167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d53025-b1fe-4b5f-9834-d1623a9d0c25 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:28.697830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d53025-b1fe-4b5f-9834-d1623a9d0c25 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:28.697830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d53025-b1fe-4b5f-9834-d1623a9d0c25 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:28.699087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:28.703996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761a71-7e0c-4ac7-b310-9e9daa9c9665 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:28.704491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761a71-7e0c-4ac7-b310-9e9daa9c9665 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:28.704640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a761a71-7e0c-4ac7-b310-9e9daa9c9665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:28.722505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5a761a71-7e0c-4ac7-b310-9e9daa9c9665 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:28.723694 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5a761a71-7e0c-4ac7-b310-9e9daa9c9665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:28.732462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:28.883837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d53025-b1fe-4b5f-9834-d1623a9d0c25 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:28.898463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d53025-b1fe-4b5f-9834-d1623a9d0c25 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:28.904638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d88049-f77f-45fc-b12d-aee93cfb67b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:28.905273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d88049-f77f-45fc-b12d-aee93cfb67b8 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:28.905572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d88049-f77f-45fc-b12d-aee93cfb67b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:28.905833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d88049-f77f-45fc-b12d-aee93cfb67b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:28.913916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d88049-f77f-45fc-b12d-aee93cfb67b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:28.915487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d88049-f77f-45fc-b12d-aee93cfb67b8 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:28.925222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 723/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:29.766088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447664-daf8-4bd8-b7dc-67c3a465fadb None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:29.766690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447664-daf8-4bd8-b7dc-67c3a465fadb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:29.766690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7447664-daf8-4bd8-b7dc-67c3a465fadb None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:29.768058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:29.773265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b74dde-91ff-47f6-982d-f2e9bb9cc768 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:29.773714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b74dde-91ff-47f6-982d-f2e9bb9cc768 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:29.773821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b74dde-91ff-47f6-982d-f2e9bb9cc768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:29.792277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-76b74dde-91ff-47f6-982d-f2e9bb9cc768 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:29.793460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-76b74dde-91ff-47f6-982d-f2e9bb9cc768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:29.801147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:29.954282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447664-daf8-4bd8-b7dc-67c3a465fadb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:29.968853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7447664-daf8-4bd8-b7dc-67c3a465fadb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:29.974229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932067-8154-4702-b51e-f8708c0c1b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:29.974866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932067-8154-4702-b51e-f8708c0c1b05 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:29.975143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932067-8154-4702-b51e-f8708c0c1b05 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:29.975427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932067-8154-4702-b51e-f8708c0c1b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:29.984503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e932067-8154-4702-b51e-f8708c0c1b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:29.986078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e932067-8154-4702-b51e-f8708c0c1b05 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:29.995380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 707/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:30.850157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab5248-c89a-48c1-8376-0944f2ac5fed None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:30.850710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab5248-c89a-48c1-8376-0944f2ac5fed None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:30.850710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab5248-c89a-48c1-8376-0944f2ac5fed None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:30.852124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:30.857360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a00e0-054a-4bc5-a112-85753395bb55 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:30.857781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a00e0-054a-4bc5-a112-85753395bb55 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:30.857889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a00e0-054a-4bc5-a112-85753395bb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:30.875898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-df3a00e0-054a-4bc5-a112-85753395bb55 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:30.877131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-df3a00e0-054a-4bc5-a112-85753395bb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:30.885364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:31.034669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab5248-c89a-48c1-8376-0944f2ac5fed None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:31.050370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab5248-c89a-48c1-8376-0944f2ac5fed None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:31.055720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207c99e-6326-4ffd-aa51-9787515a6594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:31.057017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c99e-6326-4ffd-aa51-9787515a6594 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:31.057304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c99e-6326-4ffd-aa51-9787515a6594 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:31.057592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207c99e-6326-4ffd-aa51-9787515a6594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:31.065595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207c99e-6326-4ffd-aa51-9787515a6594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:31.067167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207c99e-6326-4ffd-aa51-9787515a6594 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:31.076930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 726/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:31.939157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed71e9-b8c9-434e-8417-36bd9b2bce46 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:31.939696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed71e9-b8c9-434e-8417-36bd9b2bce46 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:31.939696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed71e9-b8c9-434e-8417-36bd9b2bce46 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:31.941048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:31.946121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95a28-670a-4857-92e5-296cc8c1e935 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:31.946523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95a28-670a-4857-92e5-296cc8c1e935 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:31.946664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec95a28-670a-4857-92e5-296cc8c1e935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:31.965278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-eec95a28-670a-4857-92e5-296cc8c1e935 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:31.966458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eec95a28-670a-4857-92e5-296cc8c1e935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:31.974023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:06:32.124131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed71e9-b8c9-434e-8417-36bd9b2bce46 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:32.139100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed71e9-b8c9-434e-8417-36bd9b2bce46 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:32.144384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccbf09e-161c-4685-8fd4-3f72080a6498 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:32.145009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbf09e-161c-4685-8fd4-3f72080a6498 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:32.145287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbf09e-161c-4685-8fd4-3f72080a6498 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:32.145559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccbf09e-161c-4685-8fd4-3f72080a6498 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:32.153585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbf09e-161c-4685-8fd4-3f72080a6498 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:32.155178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccbf09e-161c-4685-8fd4-3f72080a6498 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:32.164407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 710/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:33.010584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ebcd9-fa0e-4de3-8359-17af1e4ca6cc None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:33.011115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ebcd9-fa0e-4de3-8359-17af1e4ca6cc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:33.011115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ebcd9-fa0e-4de3-8359-17af1e4ca6cc None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:33.013088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:33.017804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c258f1-b055-4117-8954-f02591858b8a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:33.018249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c258f1-b055-4117-8954-f02591858b8a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:33.018356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c258f1-b055-4117-8954-f02591858b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:33.037241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-56c258f1-b055-4117-8954-f02591858b8a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:33.038431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-56c258f1-b055-4117-8954-f02591858b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:33.046563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:33.197452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ebcd9-fa0e-4de3-8359-17af1e4ca6cc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:33.211586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ebcd9-fa0e-4de3-8359-17af1e4ca6cc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:33.216930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983373a4-b116-4987-a64a-81324f6eca55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:33.217564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983373a4-b116-4987-a64a-81324f6eca55 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:33.217849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983373a4-b116-4987-a64a-81324f6eca55 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:33.218124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983373a4-b116-4987-a64a-81324f6eca55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:33.226131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983373a4-b116-4987-a64a-81324f6eca55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:33.227705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983373a4-b116-4987-a64a-81324f6eca55 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:33.237771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 729/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:35.303574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebae31-3efb-4987-b89c-c756287716d7 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:35.304141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebae31-3efb-4987-b89c-c756287716d7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:35.304141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebae31-3efb-4987-b89c-c756287716d7 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:35.305543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:35.313955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ff9b9-1008-4a1f-aad5-246cd68dc470 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:35.314436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ff9b9-1008-4a1f-aad5-246cd68dc470 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:35.314530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ff9b9-1008-4a1f-aad5-246cd68dc470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:35.334837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f01ff9b9-1008-4a1f-aad5-246cd68dc470 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:35.336092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f01ff9b9-1008-4a1f-aad5-246cd68dc470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:35.346190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:06:35.388606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebae31-3efb-4987-b89c-c756287716d7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:35.400697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebae31-3efb-4987-b89c-c756287716d7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:35.404477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf2cc9-7fcf-407f-8a54-85b4ceac4579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:35.405135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2cc9-7fcf-407f-8a54-85b4ceac4579 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:35.405416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2cc9-7fcf-407f-8a54-85b4ceac4579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:35.405688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf2cc9-7fcf-407f-8a54-85b4ceac4579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:35.415381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2cc9-7fcf-407f-8a54-85b4ceac4579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:35.417757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf2cc9-7fcf-407f-8a54-85b4ceac4579 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:35.432834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 713/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:37.795231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4989-6ff1-4fab-9bdb-8c46b96d9c57 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:37.795820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4989-6ff1-4fab-9bdb-8c46b96d9c57 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:37.795820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba4989-6ff1-4fab-9bdb-8c46b96d9c57 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:37.797235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:37.802403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9265f-70a5-4ac1-8268-016f07f783fa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:37.802814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9265f-70a5-4ac1-8268-016f07f783fa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:37.802956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9265f-70a5-4ac1-8268-016f07f783fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:37.821318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3cd9265f-70a5-4ac1-8268-016f07f783fa None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:37.822961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3cd9265f-70a5-4ac1-8268-016f07f783fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:37.833100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:37.875144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4989-6ff1-4fab-9bdb-8c46b96d9c57 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:37.886253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba4989-6ff1-4fab-9bdb-8c46b96d9c57 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:37.889881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a171d-f280-454a-b9a7-5ff4fcd1b84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:37.890555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a171d-f280-454a-b9a7-5ff4fcd1b84f service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:37.890840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a171d-f280-454a-b9a7-5ff4fcd1b84f service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:37.891121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a171d-f280-454a-b9a7-5ff4fcd1b84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:37.900133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a171d-f280-454a-b9a7-5ff4fcd1b84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:37.901605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a171d-f280-454a-b9a7-5ff4fcd1b84f service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:37.910949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 732/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:40.363054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f430-edfc-4717-894f-a1287d6f07e9 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:40.363608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f430-edfc-4717-894f-a1287d6f07e9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:40.363608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45f430-edfc-4717-894f-a1287d6f07e9 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:40.365019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:40.370324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1777b-2eb5-4007-bb63-67b31ace4eb8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:40.370827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1777b-2eb5-4007-bb63-67b31ace4eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:40.370931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1777b-2eb5-4007-bb63-67b31ace4eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:40.388447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b5b1777b-2eb5-4007-bb63-67b31ace4eb8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:40.389732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b5b1777b-2eb5-4007-bb63-67b31ace4eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:40.397854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:40.436963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45f430-edfc-4717-894f-a1287d6f07e9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:40.447827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45f430-edfc-4717-894f-a1287d6f07e9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:40.451458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f1ccd-ac87-4e21-ba2d-fdd4534861dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:40.452110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f1ccd-ac87-4e21-ba2d-fdd4534861dd service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:40.452419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f1ccd-ac87-4e21-ba2d-fdd4534861dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:40.452695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f1ccd-ac87-4e21-ba2d-fdd4534861dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:40.461428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f1ccd-ac87-4e21-ba2d-fdd4534861dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:40.463517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f1ccd-ac87-4e21-ba2d-fdd4534861dd service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:40.472761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 716/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:42.740378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df3ef-8d61-481d-8e16-8ebcb9ee3425 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:42.740914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df3ef-8d61-481d-8e16-8ebcb9ee3425 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:42.740914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0df3ef-8d61-481d-8e16-8ebcb9ee3425 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:42.742323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:42.748508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e44b6-5ea3-4d47-a5be-c229f229e45f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:42.748974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e44b6-5ea3-4d47-a5be-c229f229e45f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:42.749072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e44b6-5ea3-4d47-a5be-c229f229e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:42.767869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f74e44b6-5ea3-4d47-a5be-c229f229e45f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:42.769089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f74e44b6-5ea3-4d47-a5be-c229f229e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:42.777468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:42.816680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0df3ef-8d61-481d-8e16-8ebcb9ee3425 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:42.828113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0df3ef-8d61-481d-8e16-8ebcb9ee3425 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:42.831600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c2e10-1830-4caa-b639-51be39a51ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:42.832265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2e10-1830-4caa-b639-51be39a51ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:42.832553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2e10-1830-4caa-b639-51be39a51ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:42.832833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c2e10-1830-4caa-b639-51be39a51ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:42.841772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c2e10-1830-4caa-b639-51be39a51ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:42.843193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c2e10-1830-4caa-b639-51be39a51ad1 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:42.852511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 735/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:45.099312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24808d7-e19c-42c4-84ba-ffcdf6ce391a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:45.099886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24808d7-e19c-42c4-84ba-ffcdf6ce391a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:45.099886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24808d7-e19c-42c4-84ba-ffcdf6ce391a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:45.101350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:45.107786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd27508-1239-4a87-8611-4868d2c42de2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:45.108243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd27508-1239-4a87-8611-4868d2c42de2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:45.108390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd27508-1239-4a87-8611-4868d2c42de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:45.125925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-dbd27508-1239-4a87-8611-4868d2c42de2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:45.127155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dbd27508-1239-4a87-8611-4868d2c42de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:45.135712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:45.173653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24808d7-e19c-42c4-84ba-ffcdf6ce391a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:45.184135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24808d7-e19c-42c4-84ba-ffcdf6ce391a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:45.187597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e25bdb-a3e2-44bf-aa90-f5d0335a6236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:45.188373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25bdb-a3e2-44bf-aa90-f5d0335a6236 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:45.188658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25bdb-a3e2-44bf-aa90-f5d0335a6236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:45.188932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e25bdb-a3e2-44bf-aa90-f5d0335a6236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:45.198228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e25bdb-a3e2-44bf-aa90-f5d0335a6236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:45.199634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e25bdb-a3e2-44bf-aa90-f5d0335a6236 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:45.208881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 719/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:47.446037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb7f1-fc61-4fa2-8102-4881df2e1ccb None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:47.447195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb7f1-fc61-4fa2-8102-4881df2e1ccb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:47.447311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edbb7f1-fc61-4fa2-8102-4881df2e1ccb None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:47.448698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:47.453941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fe59-f2d1-480f-8c90-1a5064e1f1fb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:47.454348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fe59-f2d1-480f-8c90-1a5064e1f1fb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:47.454493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4fe59-f2d1-480f-8c90-1a5064e1f1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:47.472820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d2a4fe59-f2d1-480f-8c90-1a5064e1f1fb None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:47.474021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d2a4fe59-f2d1-480f-8c90-1a5064e1f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:47.482400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:47.521152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbb7f1-fc61-4fa2-8102-4881df2e1ccb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:47.532608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edbb7f1-fc61-4fa2-8102-4881df2e1ccb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:47.536135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7731c02-599f-4cf0-b953-87609d92594d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:47.536808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7731c02-599f-4cf0-b953-87609d92594d service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:47.537092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7731c02-599f-4cf0-b953-87609d92594d service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:47.537366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7731c02-599f-4cf0-b953-87609d92594d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:47.546199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7731c02-599f-4cf0-b953-87609d92594d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:47.547619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7731c02-599f-4cf0-b953-87609d92594d service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:47.557919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 738/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:49.798535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a613-e7b3-433c-ab0d-1e393a36e1db None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:49.799101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a613-e7b3-433c-ab0d-1e393a36e1db None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:49.799101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28a613-e7b3-433c-ab0d-1e393a36e1db None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:49.800485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:49.805864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20938da-3604-4b00-a7e4-1f95d8e2097e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:49.806318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20938da-3604-4b00-a7e4-1f95d8e2097e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:49.806433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20938da-3604-4b00-a7e4-1f95d8e2097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:49.824207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b20938da-3604-4b00-a7e4-1f95d8e2097e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:49.825391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b20938da-3604-4b00-a7e4-1f95d8e2097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:49.833020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:49.871510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a613-e7b3-433c-ab0d-1e393a36e1db None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:49.882155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28a613-e7b3-433c-ab0d-1e393a36e1db None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:49.886733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc119ca-a1bc-41c7-b6db-eb4a65d70795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:49.887368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc119ca-a1bc-41c7-b6db-eb4a65d70795 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:49.887649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc119ca-a1bc-41c7-b6db-eb4a65d70795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:49.887921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc119ca-a1bc-41c7-b6db-eb4a65d70795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:49.896721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc119ca-a1bc-41c7-b6db-eb4a65d70795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:49.898123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc119ca-a1bc-41c7-b6db-eb4a65d70795 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:49.908028 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 722/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:52.080255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141799f-f3f5-48fd-9fd5-2d743689dec8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:52.080827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141799f-f3f5-48fd-9fd5-2d743689dec8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:52.080827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141799f-f3f5-48fd-9fd5-2d743689dec8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:52.082174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:52.088130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016089b0-2fc2-4652-8003-27fa4ede8e50 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:52.088595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016089b0-2fc2-4652-8003-27fa4ede8e50 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:52.088747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016089b0-2fc2-4652-8003-27fa4ede8e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:52.094893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=79 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:06:52.107822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-016089b0-2fc2-4652-8003-27fa4ede8e50 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:52.109054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-016089b0-2fc2-4652-8003-27fa4ede8e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:52.116881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:52.155334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141799f-f3f5-48fd-9fd5-2d743689dec8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:52.160671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=73 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:06:52.167194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141799f-f3f5-48fd-9fd5-2d743689dec8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:52.170655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d07ff9c-a0bf-4fbd-8525-29629b1835b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:52.171314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07ff9c-a0bf-4fbd-8525-29629b1835b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:52.171593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07ff9c-a0bf-4fbd-8525-29629b1835b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:52.171868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d07ff9c-a0bf-4fbd-8525-29629b1835b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:52.180645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07ff9c-a0bf-4fbd-8525-29629b1835b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:52.182210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d07ff9c-a0bf-4fbd-8525-29629b1835b9 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:52.191591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 741/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:54.353509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdcbb-2ac7-4f95-ab60-2bc8f435c370 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:54.354039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdcbb-2ac7-4f95-ab60-2bc8f435c370 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:54.354160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fdcbb-2ac7-4f95-ab60-2bc8f435c370 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:54.355472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:54.361206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d80cd1-366c-48de-b053-837c037c1741 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:54.361617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d80cd1-366c-48de-b053-837c037c1741 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:54.361775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d80cd1-366c-48de-b053-837c037c1741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:54.379540 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-47d80cd1-366c-48de-b053-837c037c1741 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:54.380775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-47d80cd1-366c-48de-b053-837c037c1741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:54.389381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:54.426706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fdcbb-2ac7-4f95-ab60-2bc8f435c370 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:54.437694 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fdcbb-2ac7-4f95-ab60-2bc8f435c370 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:54.441160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb4910-0a65-4305-8173-bdf28fb55b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:54.441790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4910-0a65-4305-8173-bdf28fb55b24 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:54.442073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4910-0a65-4305-8173-bdf28fb55b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:54.442346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb4910-0a65-4305-8173-bdf28fb55b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:54.452043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb4910-0a65-4305-8173-bdf28fb55b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:54.453501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb4910-0a65-4305-8173-bdf28fb55b24 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:54.463632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 725/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:06:56.602229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cb16-53de-4d84-954f-77c1bf123c03 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:56.603424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cb16-53de-4d84-954f-77c1bf123c03 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:56.603787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5cb16-53de-4d84-954f-77c1bf123c03 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:56.605433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:06:56.611957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60961-5922-4351-90d3-eb438e269f32 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:56.612422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60961-5922-4351-90d3-eb438e269f32 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:56.612547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b60961-5922-4351-90d3-eb438e269f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:56.630265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-78b60961-5922-4351-90d3-eb438e269f32 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:06:56.631461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-78b60961-5922-4351-90d3-eb438e269f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:06:56.640134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:06:56.676886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5cb16-53de-4d84-954f-77c1bf123c03 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:06:56.687385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5cb16-53de-4d84-954f-77c1bf123c03 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:06:56.690800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d842d7-5e8f-447d-9a4d-d369a14cab6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:06:56.691429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d842d7-5e8f-447d-9a4d-d369a14cab6b service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:06:56.691709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d842d7-5e8f-447d-9a4d-d369a14cab6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:06:56.691984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d842d7-5e8f-447d-9a4d-d369a14cab6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:06:56.701284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d842d7-5e8f-447d-9a4d-d369a14cab6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:06:56.702695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d842d7-5e8f-447d-9a4d-d369a14cab6b service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:06:56.712939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 744/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:07:06.625208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=11 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:07:06.707880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=14 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:07:17.500047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ca075-a862-4bb2-9447-89fad7db8bf7 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:17.500689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ca075-a862-4bb2-9447-89fad7db8bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:17.500689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ca075-a862-4bb2-9447-89fad7db8bf7 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:17.501987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 727/1471] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:17.507103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07f0d-db49-4dda-8a56-437f34395b7f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:17.507512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07f0d-db49-4dda-8a56-437f34395b7f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:17.508236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f07f0d-db49-4dda-8a56-437f34395b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:17.526275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c0f07f0d-db49-4dda-8a56-437f34395b7f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:17.527499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c0f07f0d-db49-4dda-8a56-437f34395b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:17.535309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 745/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:17.582263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e56e-9b5f-4ddf-9e69-055779b294a8 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:17.582549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e56e-9b5f-4ddf-9e69-055779b294a8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:17.582825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736e56e-9b5f-4ddf-9e69-055779b294a8 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:17.584250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 728/1473] 10.222.0.43 () {54 vars in 962 bytes} [Thu Jun 16 21:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:17.589749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bca0-1754-4a8c-98ac-fb92e1209c62 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:17.590062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bca0-1754-4a8c-98ac-fb92e1209c62 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:17.590325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4bca0-1754-4a8c-98ac-fb92e1209c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:17.608863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b9e4bca0-1754-4a8c-98ac-fb92e1209c62 None None] MFA Rules not processed for user `4fd5a266491c487385349368b5ccbbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:17.610068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b9e4bca0-1754-4a8c-98ac-fb92e1209c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:17.616567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 746/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Jun 16 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:17.623892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736e56e-9b5f-4ddf-9e69-055779b294a8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:07:17.634755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736e56e-9b5f-4ddf-9e69-055779b294a8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:07:17.638172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f6c87-0131-450c-8734-8869c85cd2e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd5a266491c487385349368b5ccbbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:07:17.638790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6c87-0131-450c-8734-8869c85cd2e8 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:17.639066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6c87-0131-450c-8734-8869c85cd2e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:17.639338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f6c87-0131-450c-8734-8869c85cd2e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:17.647944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f6c87-0131-450c-8734-8869c85cd2e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:07:17.650004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f6c87-0131-450c-8734-8869c85cd2e8 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:07:17.659384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 729/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:07:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:07:19.921091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56285704-e2d5-4022-b712-f2305337f2df None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:19.921627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56285704-e2d5-4022-b712-f2305337f2df None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:19.921627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56285704-e2d5-4022-b712-f2305337f2df None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:19.922973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 747/1476] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:19.928206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3543e5-a239-4e49-813b-4acef678ad5c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:19.928653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3543e5-a239-4e49-813b-4acef678ad5c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:19.928767 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3543e5-a239-4e49-813b-4acef678ad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:19.946571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9a3543e5-a239-4e49-813b-4acef678ad5c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:19.947743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9a3543e5-a239-4e49-813b-4acef678ad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:19.955678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 730/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:19.981312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56285704-e2d5-4022-b712-f2305337f2df None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:07:19.993671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56285704-e2d5-4022-b712-f2305337f2df None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:07:19.998125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83de71-c7b8-4f37-b8e0-242faedbc3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:07:19.998785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83de71-c7b8-4f37-b8e0-242faedbc3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:19.999056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83de71-c7b8-4f37-b8e0-242faedbc3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:19.999337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83de71-c7b8-4f37-b8e0-242faedbc3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:20.000074 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83de71-c7b8-4f37-b8e0-242faedbc3f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:07:20.001904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-2b83de71-c7b8-4f37-b8e0-242faedbc3f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:07:20.001904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:07:20.001904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:07:20.003081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83de71-c7b8-4f37-b8e0-242faedbc3f0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:07:20.022507 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 748/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Jun 16 21:07:19 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:07:22.173520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837318c-acbd-4bdc-b81b-f5f717b3d3cd None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:22.174090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837318c-acbd-4bdc-b81b-f5f717b3d3cd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:22.174090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837318c-acbd-4bdc-b81b-f5f717b3d3cd None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:22.175514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 731/1479] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:22.181269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdd4b-5fec-4153-8165-7a6b981f21a2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:22.181667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdd4b-5fec-4153-8165-7a6b981f21a2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:22.181835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bdd4b-5fec-4153-8165-7a6b981f21a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:22.199356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ed0bdd4b-5fec-4153-8165-7a6b981f21a2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:22.200610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ed0bdd4b-5fec-4153-8165-7a6b981f21a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:22.209638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 749/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:22.254234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837318c-acbd-4bdc-b81b-f5f717b3d3cd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:07:22.269140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837318c-acbd-4bdc-b81b-f5f717b3d3cd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:07:22.275572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d86d0-304f-41e1-ad1b-ca54f1a22b88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:07:22.276233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d86d0-304f-41e1-ad1b-ca54f1a22b88 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:22.276518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d86d0-304f-41e1-ad1b-ca54f1a22b88 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:22.276791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d86d0-304f-41e1-ad1b-ca54f1a22b88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:22.284819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d86d0-304f-41e1-ad1b-ca54f1a22b88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:07:22.286385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d86d0-304f-41e1-ad1b-ca54f1a22b88 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:07:22.296751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 732/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:07:24.620312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c907-9914-4311-a600-f9a017f781c8 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:24.620767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c907-9914-4311-a600-f9a017f781c8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:24.620881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c907-9914-4311-a600-f9a017f781c8 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:24.622273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 750/1482] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:24.627476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ae83-5140-4628-9a67-e34fbce713f0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:24.627862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ae83-5140-4628-9a67-e34fbce713f0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:24.628034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ae83-5140-4628-9a67-e34fbce713f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:24.645655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5386ae83-5140-4628-9a67-e34fbce713f0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:24.646855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5386ae83-5140-4628-9a67-e34fbce713f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:24.655302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 733/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:24.690740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304c907-9914-4311-a600-f9a017f781c8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:07:24.701346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304c907-9914-4311-a600-f9a017f781c8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:07:24.704750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe8444-4a2c-43aa-937b-32e6d3ef5334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:07:24.705381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8444-4a2c-43aa-937b-32e6d3ef5334 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:24.705661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8444-4a2c-43aa-937b-32e6d3ef5334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:24.705963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe8444-4a2c-43aa-937b-32e6d3ef5334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:24.715124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8444-4a2c-43aa-937b-32e6d3ef5334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:07:24.716576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe8444-4a2c-43aa-937b-32e6d3ef5334 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:07:24.725647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 751/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:07:26.922690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703f399-7417-471f-b425-12c4f4b693e8 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:26.923220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703f399-7417-471f-b425-12c4f4b693e8 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:26.923220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703f399-7417-471f-b425-12c4f4b693e8 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:26.924564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 734/1485] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:26.930065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2edc-64b6-4074-b3c8-0dc91f1fca20 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:26.930489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2edc-64b6-4074-b3c8-0dc91f1fca20 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:26.930622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a2edc-64b6-4074-b3c8-0dc91f1fca20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:26.949189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-351a2edc-64b6-4074-b3c8-0dc91f1fca20 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:26.950404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-351a2edc-64b6-4074-b3c8-0dc91f1fca20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:26.958237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 752/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:26.997379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703f399-7417-471f-b425-12c4f4b693e8 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:07:27.007958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703f399-7417-471f-b425-12c4f4b693e8 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:07:27.011451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04575ed3-b458-4634-8334-4594d2fdb662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:07:27.012083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04575ed3-b458-4634-8334-4594d2fdb662 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:27.012402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04575ed3-b458-4634-8334-4594d2fdb662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:27.012678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04575ed3-b458-4634-8334-4594d2fdb662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:27.021450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04575ed3-b458-4634-8334-4594d2fdb662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:07:27.023578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04575ed3-b458-4634-8334-4594d2fdb662 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:07:27.032777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 735/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:07:29.366233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d315-3a31-4901-bee2-6405c986561f None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:29.367339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d315-3a31-4901-bee2-6405c986561f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:29.367339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638d315-3a31-4901-bee2-6405c986561f None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:29.368806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 753/1488] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:29.373902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81959-6d8f-464c-a192-deb4e0177d51 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:29.374341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81959-6d8f-464c-a192-deb4e0177d51 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:29.374470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81959-6d8f-464c-a192-deb4e0177d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:29.393018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-feb81959-6d8f-464c-a192-deb4e0177d51 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:29.394239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-feb81959-6d8f-464c-a192-deb4e0177d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:29.402630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 736/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:29.443700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d315-3a31-4901-bee2-6405c986561f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:07:29.454454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638d315-3a31-4901-bee2-6405c986561f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:07:29.457954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec18d0-c54f-4fac-851c-eea88b8a5027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:07:29.458582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec18d0-c54f-4fac-851c-eea88b8a5027 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:29.458862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec18d0-c54f-4fac-851c-eea88b8a5027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:29.459136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec18d0-c54f-4fac-851c-eea88b8a5027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:29.467934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec18d0-c54f-4fac-851c-eea88b8a5027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:07:29.469383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec18d0-c54f-4fac-851c-eea88b8a5027 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:07:29.479054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 754/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:07:31.758410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4319f-20b1-4661-8289-21f33c34b646 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:31.758975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4319f-20b1-4661-8289-21f33c34b646 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:31.758975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4319f-20b1-4661-8289-21f33c34b646 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:31.760389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 737/1491] 10.222.0.43 () {54 vars in 926 bytes} [Thu Jun 16 21:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:07:31.765675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab23c43-7ba5-4def-ac66-527168b2fce8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:31.766087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab23c43-7ba5-4def-ac66-527168b2fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:31.766260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab23c43-7ba5-4def-ac66-527168b2fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:31.784348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9ab23c43-7ba5-4def-ac66-527168b2fce8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:07:31.785542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9ab23c43-7ba5-4def-ac66-527168b2fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:07:31.794409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 755/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Thu Jun 16 21:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:07:31.833737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4319f-20b1-4661-8289-21f33c34b646 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:07:31.844981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4319f-20b1-4661-8289-21f33c34b646 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:07:31.849005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b40641-933e-454f-9ca0-99439a2b580e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:07:31.849160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40641-933e-454f-9ca0-99439a2b580e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:07:31.849403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40641-933e-454f-9ca0-99439a2b580e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:07:31.849679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b40641-933e-454f-9ca0-99439a2b580e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:07:31.859390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b40641-933e-454f-9ca0-99439a2b580e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:07:31.860793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b40641-933e-454f-9ca0-99439a2b580e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:07:31.870275 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 738/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:07:41.779100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=33 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:07:41.865923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=33 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:09:21.022273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69bc3-0390-43c8-a048-f8fad1309e9e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.022886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69bc3-0390-43c8-a048-f8fad1309e9e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.022886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69bc3-0390-43c8-a048-f8fad1309e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.040456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-84f69bc3-0390-43c8-a048-f8fad1309e9e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:09:21.041659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-84f69bc3-0390-43c8-a048-f8fad1309e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:09:21.049438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 756/1494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:09:21.059263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb7f1b-d68d-4f56-a2f9-efd6fb134f10 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.059786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb7f1b-d68d-4f56-a2f9-efd6fb134f10 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.059884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb7f1b-d68d-4f56-a2f9-efd6fb134f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.078393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-34cb7f1b-d68d-4f56-a2f9-efd6fb134f10 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:09:21.079576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-34cb7f1b-d68d-4f56-a2f9-efd6fb134f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:09:21.087798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 739/1495] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:09:21.092248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69bc3-0390-43c8-a048-f8fad1309e9e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.102407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69bc3-0390-43c8-a048-f8fad1309e9e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.107192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.107853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.108137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.108444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.109173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:09:21.109486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.110503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:21.110503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:09:21.110503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:09:21.111407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.123510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 757/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:09:21.131990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb7f1b-d68d-4f56-a2f9-efd6fb134f10 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.140975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb7f1b-d68d-4f56-a2f9-efd6fb134f10 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.146256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.146910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.147193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.147467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.148153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.149941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:21.149941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 16 21:09:21.149941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: Jun 16 21:09:21.151129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.187800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 740/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:09:21 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:09:21.191867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.202084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa493d8e-e2a9-4a45-8728-9925e603eef2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.257655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.258325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.258612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.258889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.259584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.260630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:21.260630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:09:21.260630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:09:21.261829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.280974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 758/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:09:21 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:09:21.285027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.296051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318269-9dc7-4ee0-bd3f-c3d15b6a59b0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.300672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.301332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.301613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.302489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.303221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.304265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:21.304265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 16 21:09:21.304265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: Jun 16 21:09:21.305143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.317942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 741/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:09:21.322388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.332164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700047d-a1f5-42cf-b4d2-f544357055c7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.336953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab13c3-4805-4d0a-bf53-dc4f982f2c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.337646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab13c3-4805-4d0a-bf53-dc4f982f2c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.337931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab13c3-4805-4d0a-bf53-dc4f982f2c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.338210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab13c3-4805-4d0a-bf53-dc4f982f2c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.338939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab13c3-4805-4d0a-bf53-dc4f982f2c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.339985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-64ab13c3-4805-4d0a-bf53-dc4f982f2c1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:21.339985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:09:21.339985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:09:21.340910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab13c3-4805-4d0a-bf53-dc4f982f2c1e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.356144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 759/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:09:21.360031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.370207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e30cc-bb89-47f1-985a-c0349b19ea30 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.374625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e938c-3e65-4dc1-a443-0294e98b3913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.375496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e938c-3e65-4dc1-a443-0294e98b3913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.375770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e938c-3e65-4dc1-a443-0294e98b3913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.376042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e938c-3e65-4dc1-a443-0294e98b3913 admin admin] PATH_INFO: `/v3/projects/59006f76d7c54d4697d9f168012284d1/users/07d757c7e0e0459e936df6fa66e4fa40/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.390828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e938c-3e65-4dc1-a443-0294e98b3913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59006f76d7c54d4697d9f168012284d1, user_id=07d757c7e0e0459e936df6fa66e4fa40, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.391857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-bf9e938c-3e65-4dc1-a443-0294e98b3913 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:21.391857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 16 21:09:21.391857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: Jun 16 21:09:21.393809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e938c-3e65-4dc1-a443-0294e98b3913 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.406703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 742/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:09:21 2022] PUT /identity/v3/projects/59006f76d7c54d4697d9f168012284d1/users/07d757c7e0e0459e936df6fa66e4fa40/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:09:21.417974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a288-8cb1-480a-8944-ed816a537dec None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.418271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a288-8cb1-480a-8944-ed816a537dec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.418556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640a288-8cb1-480a-8944-ed816a537dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.445457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2640a288-8cb1-480a-8944-ed816a537dec None None] MFA Rules not processed for user `07d757c7e0e0459e936df6fa66e4fa40`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:09:21.446840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2640a288-8cb1-480a-8944-ed816a537dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:09:21.511044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 760/1502] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:09:21.524394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a760-5b34-4ec5-9066-4e7908ca6d56 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.524687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a760-5b34-4ec5-9066-4e7908ca6d56 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.524969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49a760-5b34-4ec5-9066-4e7908ca6d56 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.526362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 743/1503] 10.222.0.43 () {54 vars in 963 bytes} [Thu Jun 16 21:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:09:21.531069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11715-7a34-4352-9dec-f7906a4d6d51 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.531311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11715-7a34-4352-9dec-f7906a4d6d51 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.531592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec11715-7a34-4352-9dec-f7906a4d6d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.549425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3ec11715-7a34-4352-9dec-f7906a4d6d51 None None] MFA Rules not processed for user `35b6a283856448d9aca6f50a3d58742f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:09:21.550630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3ec11715-7a34-4352-9dec-f7906a4d6d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:09:21.595820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:09:21.606984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 761/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Thu Jun 16 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:09:21.615725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49a760-5b34-4ec5-9066-4e7908ca6d56 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.626645 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49a760-5b34-4ec5-9066-4e7908ca6d56 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.630847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.631667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.631953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.632260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.640576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.642002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.651004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 744/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:09:21.693260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b971-2d33-4b97-a607-960aedef84de None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.693558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b971-2d33-4b97-a607-960aedef84de None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.693859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655b971-2d33-4b97-a607-960aedef84de None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.695139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 762/1506] 10.222.0.43 () {52 vars in 829 bytes} [Thu Jun 16 21:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:09:21.698736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.759987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e466bb-ea18-4614-8ea4-0d72b8bf1e5c service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:21.764601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:21.765481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.765762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.766036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] PATH_INFO: `/v3/users/07d757c7e0e0459e936df6fa66e4fa40` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.767221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d757c7e0e0459e936df6fa66e4fa40)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:21.768266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:21.768266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 16 21:09:21.768266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: Jun 16 21:09:21.769457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:21.834967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d757c7e0e0459e936df6fa66e4fa40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:21.835706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d757c7e0e0459e936df6fa66e4fa40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:21.836358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d757c7e0e0459e936df6fa66e4fa40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:21.854965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d757c7e0e0459e936df6fa66e4fa40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:21.864416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d757c7e0e0459e936df6fa66e4fa40'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:21.873087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:09:21.885016 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 745/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:09:21 2022] DELETE /identity/v3/users/07d757c7e0e0459e936df6fa66e4fa40 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:09:21.889465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:21.889758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:21.890038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:21.911730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:09:21.913916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:09:21.971314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 763/1508] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:09:21.981141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:21.982546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:09:22.040451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ccd18-f3a2-45ec-8d89-d4e650b49646 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:22.044016 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7203056-531e-4498-98fb-16dddd0954af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:22.044704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7203056-531e-4498-98fb-16dddd0954af service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:22.044991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7203056-531e-4498-98fb-16dddd0954af service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:22.045276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7203056-531e-4498-98fb-16dddd0954af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:22.054966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7203056-531e-4498-98fb-16dddd0954af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:22.056453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7203056-531e-4498-98fb-16dddd0954af service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:22.065772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 746/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:09:22.399264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:09:22.400837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:09:22.414966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80772ac0-97c1-4fb6-b1c2-ffafb417f5dc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:09:22.419819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:09:22.420722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:09:22.421012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:09:22.421291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] PATH_INFO: `/v3/projects/59006f76d7c54d4697d9f168012284d1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:09:22.422492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59006f76d7c54d4697d9f168012284d1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:09:22.423516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:09:22.423516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:09:22.423516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:09:22.424758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:09:22.488382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59006f76d7c54d4697d9f168012284d1', 'request_id': 'req-dc09ca76-666b-49da-b089-678c406edaa0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:22.501766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59006f76d7c54d4697d9f168012284d1', 'request_id': 'req-dc09ca76-666b-49da-b089-678c406edaa0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:22.512483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59006f76d7c54d4697d9f168012284d1', 'request_id': 'req-dc09ca76-666b-49da-b089-678c406edaa0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:22.524380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] The token cache is being invalidate because project 59006f76d7c54d4697d9f168012284d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:09:22.524713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:22.525440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dc09ca76-666b-49da-b089-678c406edaa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:09:22.527007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 764/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:09:22 2022] DELETE /identity/v3/projects/59006f76d7c54d4697d9f168012284d1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:09:32.061599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=29 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:09:32.520675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:10:56.842539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64516a60-13d8-49cb-9052-8d9cb3be9a5a None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:56.843153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64516a60-13d8-49cb-9052-8d9cb3be9a5a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:56.843258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64516a60-13d8-49cb-9052-8d9cb3be9a5a None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:56.844665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:10:56.849421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83999f-b55f-4e62-a59f-f98c11c3a597 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:56.849823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83999f-b55f-4e62-a59f-f98c11c3a597 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:56.849986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83999f-b55f-4e62-a59f-f98c11c3a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:56.869461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-eb83999f-b55f-4e62-a59f-f98c11c3a597 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:10:56.870659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eb83999f-b55f-4e62-a59f-f98c11c3a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:10:56.928045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:10:57.100104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64516a60-13d8-49cb-9052-8d9cb3be9a5a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:10:57.101957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-64516a60-13d8-49cb-9052-8d9cb3be9a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:10:57.188699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64516a60-13d8-49cb-9052-8d9cb3be9a5a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:10:57.194066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6599ea7-5bf0-4275-a567-db50a447e4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:10:57.195225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599ea7-5bf0-4275-a567-db50a447e4a7 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:57.195545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599ea7-5bf0-4275-a567-db50a447e4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:57.195817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6599ea7-5bf0-4275-a567-db50a447e4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:57.204761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6599ea7-5bf0-4275-a567-db50a447e4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:10:57.206366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6599ea7-5bf0-4275-a567-db50a447e4a7 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:10:57.216525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 748/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:10:58.088670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bd42a-d6ba-48d9-85fd-b7053aa04754 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:58.089241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bd42a-d6ba-48d9-85fd-b7053aa04754 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:58.089241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bd42a-d6ba-48d9-85fd-b7053aa04754 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:58.090627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:10:58.095418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eace6-7d08-4580-b169-2be5a69fab9e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:58.095848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eace6-7d08-4580-b169-2be5a69fab9e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:58.095954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58eace6-7d08-4580-b169-2be5a69fab9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:58.113971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d58eace6-7d08-4580-b169-2be5a69fab9e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:10:58.115178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d58eace6-7d08-4580-b169-2be5a69fab9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:10:58.123153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:10:58.281743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bd42a-d6ba-48d9-85fd-b7053aa04754 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:10:58.296962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bd42a-d6ba-48d9-85fd-b7053aa04754 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:10:58.302447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e30324-eef1-4bf2-b42d-a395e27c808f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:10:58.303086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30324-eef1-4bf2-b42d-a395e27c808f service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:58.303374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30324-eef1-4bf2-b42d-a395e27c808f service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:58.303655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30324-eef1-4bf2-b42d-a395e27c808f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:58.312891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e30324-eef1-4bf2-b42d-a395e27c808f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:10:58.314512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e30324-eef1-4bf2-b42d-a395e27c808f service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:10:58.326144 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 767/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:10:58.782707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227474-2dca-4e04-a151-f253aa621d95 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:58.782917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227474-2dca-4e04-a151-f253aa621d95 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:58.783200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6227474-2dca-4e04-a151-f253aa621d95 None None] PATH_INFO: `/v3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:58.784635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 750/1517] 10.222.0.47 () {54 vars in 925 bytes} [Thu Jun 16 21:10:58 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:10:58.808384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fee55-0ddd-4fe5-915a-42d122478f1d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:10:58.808680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fee55-0ddd-4fe5-915a-42d122478f1d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:10:58.808993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fee55-0ddd-4fe5-915a-42d122478f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:10:58.826844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ee1fee55-0ddd-4fe5-915a-42d122478f1d None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:10:58.828042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ee1fee55-0ddd-4fe5-915a-42d122478f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:10:58.889174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 768/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 16 21:10:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:11:02.742570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c706-43d7-4a9e-ab15-5027bcef4199 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:02.743158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c706-43d7-4a9e-ab15-5027bcef4199 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:02.743158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9c706-43d7-4a9e-ab15-5027bcef4199 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:02.744459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 751/1519] 10.222.0.43 () {54 vars in 960 bytes} [Thu Jun 16 21:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:11:02.749446 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb297f-d6d2-4e52-9352-743016d7c34d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:02.749882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb297f-d6d2-4e52-9352-743016d7c34d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:02.749998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb297f-d6d2-4e52-9352-743016d7c34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:02.769495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-23bb297f-d6d2-4e52-9352-743016d7c34d None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:11:02.770750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-23bb297f-d6d2-4e52-9352-743016d7c34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:02.780097 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 769/1520] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Jun 16 21:11:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:11:02.787727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c706-43d7-4a9e-ab15-5027bcef4199 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:11:02.801619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9c706-43d7-4a9e-ab15-5027bcef4199 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:11:02.807035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830a434-0b0e-4cd5-a4f4-e00a720f8fdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:11:02.807652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830a434-0b0e-4cd5-a4f4-e00a720f8fdf service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:02.807920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830a434-0b0e-4cd5-a4f4-e00a720f8fdf service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:02.808216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830a434-0b0e-4cd5-a4f4-e00a720f8fdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:02.816464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830a434-0b0e-4cd5-a4f4-e00a720f8fdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:11:02.818043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830a434-0b0e-4cd5-a4f4-e00a720f8fdf service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:11:02.828009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 752/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:11:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:11:09.624907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8857b-0aff-4c4c-9f21-110f220beb44 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:09.625413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8857b-0aff-4c4c-9f21-110f220beb44 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:09.625530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8857b-0aff-4c4c-9f21-110f220beb44 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:09.626856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:11:09.631679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1370-42fd-40b6-a6c6-74f0323412d4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:09.632246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1370-42fd-40b6-a6c6-74f0323412d4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:09.632423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a1370-42fd-40b6-a6c6-74f0323412d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:09.650395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d01a1370-42fd-40b6-a6c6-74f0323412d4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:11:09.651589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d01a1370-42fd-40b6-a6c6-74f0323412d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:09.659398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:11:09.813306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8857b-0aff-4c4c-9f21-110f220beb44 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:11:09.828157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8857b-0aff-4c4c-9f21-110f220beb44 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:11:09.833478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454fa30c-512a-4b3d-995c-3377faf13d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:11:09.834135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa30c-512a-4b3d-995c-3377faf13d4b service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:09.834414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa30c-512a-4b3d-995c-3377faf13d4b service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:09.834687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454fa30c-512a-4b3d-995c-3377faf13d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:09.843501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fa30c-512a-4b3d-995c-3377faf13d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:11:09.845109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454fa30c-512a-4b3d-995c-3377faf13d4b service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:11:09.854533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 771/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:11:10.731166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e90b-be50-4c99-a872-db6d2f8e06df None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:10.731973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e90b-be50-4c99-a872-db6d2f8e06df None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:10.731973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21e90b-be50-4c99-a872-db6d2f8e06df None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:10.733354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 21:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:11:10.738247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82459-d581-4bfd-aea9-55b397ebd70a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:10.738717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82459-d581-4bfd-aea9-55b397ebd70a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:10.738824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82459-d581-4bfd-aea9-55b397ebd70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:10.756387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5cb82459-d581-4bfd-aea9-55b397ebd70a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:11:10.758381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5cb82459-d581-4bfd-aea9-55b397ebd70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:10.766045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 21:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:11:10.916721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e90b-be50-4c99-a872-db6d2f8e06df None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:11:10.931419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21e90b-be50-4c99-a872-db6d2f8e06df None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:11:10.936798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c015f1c-d0d1-4262-87ed-069253b21ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:11:10.937437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015f1c-d0d1-4262-87ed-069253b21ac5 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:10.937722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015f1c-d0d1-4262-87ed-069253b21ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:10.938000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c015f1c-d0d1-4262-87ed-069253b21ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:10.947371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c015f1c-d0d1-4262-87ed-069253b21ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:11:10.949031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c015f1c-d0d1-4262-87ed-069253b21ac5 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:11:10.959972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 755/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:11:14.961572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3775-13ef-4eea-9b5d-bed423a05cb2 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:14.962178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3775-13ef-4eea-9b5d-bed423a05cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:14.962178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3775-13ef-4eea-9b5d-bed423a05cb2 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:14.963493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:11:14.968807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a88b2-6907-4b78-ba3c-e2b95c46ea39 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:14.969238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a88b2-6907-4b78-ba3c-e2b95c46ea39 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:14.969373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a88b2-6907-4b78-ba3c-e2b95c46ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:14.987903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-001a88b2-6907-4b78-ba3c-e2b95c46ea39 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:11:14.989133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-001a88b2-6907-4b78-ba3c-e2b95c46ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:14.997088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:11:15.033601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c3775-13ef-4eea-9b5d-bed423a05cb2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:11:15.035274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-638c3775-13ef-4eea-9b5d-bed423a05cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:15.092201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c3775-13ef-4eea-9b5d-bed423a05cb2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:11:15.095644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6dcb-a9ae-466a-b874-c701261fcaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:11:15.096323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6dcb-a9ae-466a-b874-c701261fcaad service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:15.096605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6dcb-a9ae-466a-b874-c701261fcaad service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:15.096877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6dcb-a9ae-466a-b874-c701261fcaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:15.105807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6dcb-a9ae-466a-b874-c701261fcaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:11:15.107483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6dcb-a9ae-466a-b874-c701261fcaad service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:11:15.112353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:11:15.117651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 774/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:11:17.247026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecab41-82d7-4c30-b532-47c4f747a25f None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:17.247567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecab41-82d7-4c30-b532-47c4f747a25f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:17.247567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecab41-82d7-4c30-b532-47c4f747a25f None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:17.249001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:11:17.254212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99ba2b-ac12-494a-91f6-a7539c2169ea None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:17.254617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99ba2b-ac12-494a-91f6-a7539c2169ea None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:17.254771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99ba2b-ac12-494a-91f6-a7539c2169ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:17.273946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bd99ba2b-ac12-494a-91f6-a7539c2169ea None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:11:17.275157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bd99ba2b-ac12-494a-91f6-a7539c2169ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:17.282976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:11:17.317827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecab41-82d7-4c30-b532-47c4f747a25f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:11:17.329370 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecab41-82d7-4c30-b532-47c4f747a25f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:11:17.332966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936d5ad-6c0b-4375-807d-cb57119924ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:11:17.333600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d5ad-6c0b-4375-807d-cb57119924ba service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:17.333885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d5ad-6c0b-4375-807d-cb57119924ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:17.334164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d5ad-6c0b-4375-807d-cb57119924ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:17.344167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936d5ad-6c0b-4375-807d-cb57119924ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:11:17.345623 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a936d5ad-6c0b-4375-807d-cb57119924ba service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:11:17.355151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 758/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:11:21.013796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2a0be-db1d-43c3-924b-5480c0922174 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:21.014366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2a0be-db1d-43c3-924b-5480c0922174 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:21.014366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2a0be-db1d-43c3-924b-5480c0922174 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:21.015770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:11:21.021018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb33d1-ef97-4c6c-8719-6e1d9180a791 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:21.021444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb33d1-ef97-4c6c-8719-6e1d9180a791 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:21.021603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb33d1-ef97-4c6c-8719-6e1d9180a791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:21.040453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1bfb33d1-ef97-4c6c-8719-6e1d9180a791 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:11:21.041646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1bfb33d1-ef97-4c6c-8719-6e1d9180a791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:21.049438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:11:21.316392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2a0be-db1d-43c3-924b-5480c0922174 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:11:21.318044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3fb2a0be-db1d-43c3-924b-5480c0922174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:21.375410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2a0be-db1d-43c3-924b-5480c0922174 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:11:21.378935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22995155-c346-4f67-b50b-c093dd3834f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:11:21.379572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995155-c346-4f67-b50b-c093dd3834f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:21.379857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995155-c346-4f67-b50b-c093dd3834f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:21.380135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22995155-c346-4f67-b50b-c093dd3834f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:21.389729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22995155-c346-4f67-b50b-c093dd3834f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:11:21.391171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22995155-c346-4f67-b50b-c093dd3834f7 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:11:21.401091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 777/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:11:23.557804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea70da9-64ce-45de-ba7f-bcda91f92798 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:23.558377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea70da9-64ce-45de-ba7f-bcda91f92798 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:23.558377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea70da9-64ce-45de-ba7f-bcda91f92798 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:23.559777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 21:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:11:23.564956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404bc88-8ed3-4b9d-963b-0f4f7ccb4dec None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:23.565378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404bc88-8ed3-4b9d-963b-0f4f7ccb4dec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:23.565517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404bc88-8ed3-4b9d-963b-0f4f7ccb4dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:23.583704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7404bc88-8ed3-4b9d-963b-0f4f7ccb4dec None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:11:23.584929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7404bc88-8ed3-4b9d-963b-0f4f7ccb4dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:23.593221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 21:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:11:23.865929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea70da9-64ce-45de-ba7f-bcda91f92798 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:11:23.868115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aea70da9-64ce-45de-ba7f-bcda91f92798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:11:23.875692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=65 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:11:23.882680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea70da9-64ce-45de-ba7f-bcda91f92798 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:11:23.886170 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76584f-c986-45ee-b7fe-bcfca61a5f31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:11:23.886817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76584f-c986-45ee-b7fe-bcfca61a5f31 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:11:23.887102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76584f-c986-45ee-b7fe-bcfca61a5f31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:11:23.887378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76584f-c986-45ee-b7fe-bcfca61a5f31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:11:23.896195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76584f-c986-45ee-b7fe-bcfca61a5f31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:11:23.897634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76584f-c986-45ee-b7fe-bcfca61a5f31 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:11:23.906909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 761/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:11:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:11:33.578481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=32 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:11:33.902872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:53.354545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2868-0de3-450c-b916-300197ce8c08 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.355206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2868-0de3-450c-b916-300197ce8c08 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.355206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2868-0de3-450c-b916-300197ce8c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.379304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ed7b2868-0de3-450c-b916-300197ce8c08 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.381072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ed7b2868-0de3-450c-b916-300197ce8c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.385128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e41cf-7b80-4152-ba44-4123aa39fea3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.386220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e41cf-7b80-4152-ba44-4123aa39fea3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.386727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e41cf-7b80-4152-ba44-4123aa39fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.395191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 779/1540] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.401955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fdb98-5570-4354-b9ba-4bcae258850a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.402493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fdb98-5570-4354-b9ba-4bcae258850a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.402941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0fdb98-5570-4354-b9ba-4bcae258850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.421229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-590e41cf-7b80-4152-ba44-4123aa39fea3 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.422833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-590e41cf-7b80-4152-ba44-4123aa39fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.429777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-fc0fdb98-5570-4354-b9ba-4bcae258850a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.431737 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fc0fdb98-5570-4354-b9ba-4bcae258850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.439680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 762/1541] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.441429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef8e0-81bd-4eed-8f98-5f5adb697bed None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.442957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef8e0-81bd-4eed-8f98-5f5adb697bed None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.443931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ef8e0-81bd-4eed-8f98-5f5adb697bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.454869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 780/1542] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:12:53.458620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e7a1a-ee5b-4709-a74d-e5bdb5cd9272 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.461462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e7a1a-ee5b-4709-a74d-e5bdb5cd9272 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.462110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e7a1a-ee5b-4709-a74d-e5bdb5cd9272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.493747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-522ef8e0-81bd-4eed-8f98-5f5adb697bed None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.495333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-522ef8e0-81bd-4eed-8f98-5f5adb697bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.510244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-434e7a1a-ee5b-4709-a74d-e5bdb5cd9272 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.514978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-434e7a1a-ee5b-4709-a74d-e5bdb5cd9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.516790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 763/1543] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.519591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a2ae-a0ae-425e-9f12-8e8509c1dddc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.521214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a2ae-a0ae-425e-9f12-8e8509c1dddc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.522589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86a2ae-a0ae-425e-9f12-8e8509c1dddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.546308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 781/1544] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.548080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0a5e-39dd-405e-ae0d-c409667a38ed None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.549634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0a5e-39dd-405e-ae0d-c409667a38ed None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.550600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb0a5e-39dd-405e-ae0d-c409667a38ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.569490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6d86a2ae-a0ae-425e-9f12-8e8509c1dddc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.571258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6d86a2ae-a0ae-425e-9f12-8e8509c1dddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.590152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 764/1545] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.595511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a2ae-a0ae-425e-9f12-8e8509c1dddc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:53.598532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-60cb0a5e-39dd-405e-ae0d-c409667a38ed None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.600136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-60cb0a5e-39dd-405e-ae0d-c409667a38ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.622157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86a2ae-a0ae-425e-9f12-8e8509c1dddc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:53.628673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:53.629758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.630219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.630729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.631807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:53.632332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:53.634034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:12:53.634034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 16 21:12:53.634034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: Jun 16 21:12:53.635284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:53.644448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 782/1546] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.645480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb0a5e-39dd-405e-ae0d-c409667a38ed None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:53.655918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 765/1547] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:53.657181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:53.668390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb0a5e-39dd-405e-ae0d-c409667a38ed None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:53.675162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7ab4d-71e2-4b6a-ae94-d817598d7404 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:53.690502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa97d26-e0c0-4282-8182-6164e7355063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:53.691648 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97d26-e0c0-4282-8182-6164e7355063 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.692538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97d26-e0c0-4282-8182-6164e7355063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.692998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97d26-e0c0-4282-8182-6164e7355063 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.694329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa97d26-e0c0-4282-8182-6164e7355063 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:53.694981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa97d26-e0c0-4282-8182-6164e7355063 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:53.698098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa97d26-e0c0-4282-8182-6164e7355063 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:53.698898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188ba89-10dd-40f7-9314-101a5008bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:53.699702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188ba89-10dd-40f7-9314-101a5008bd76 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.700138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188ba89-10dd-40f7-9314-101a5008bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.700581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188ba89-10dd-40f7-9314-101a5008bd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.701547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188ba89-10dd-40f7-9314-101a5008bd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:53.701858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188ba89-10dd-40f7-9314-101a5008bd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:53.703578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188ba89-10dd-40f7-9314-101a5008bd76 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:53.716520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 766/1548] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:53.718242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed375e-2845-4b3c-ae46-787972b83590 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.718685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed375e-2845-4b3c-ae46-787972b83590 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.719143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed375e-2845-4b3c-ae46-787972b83590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.728458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 783/1549] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:53.728924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab728-87db-4004-bf56-88f42416a16f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.729355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab728-87db-4004-bf56-88f42416a16f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.731666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ab728-87db-4004-bf56-88f42416a16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.740012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-abed375e-2845-4b3c-ae46-787972b83590 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.741272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-abed375e-2845-4b3c-ae46-787972b83590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.752263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 767/1550] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.753575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed375e-2845-4b3c-ae46-787972b83590 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:53.755102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-499ab728-87db-4004-bf56-88f42416a16f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.760312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-499ab728-87db-4004-bf56-88f42416a16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.766176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed375e-2845-4b3c-ae46-787972b83590 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:53.772857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 784/1551] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.773561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:53.773666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf40f4-9d58-4c22-a5eb-410fd734f934 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.773666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf40f4-9d58-4c22-a5eb-410fd734f934 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.773830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.773916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf40f4-9d58-4c22-a5eb-410fd734f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.773999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.773999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.773999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:53.775852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:53.792666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a8cf40f4-9d58-4c22-a5eb-410fd734f934 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.794111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a8cf40f4-9d58-4c22-a5eb-410fd734f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.809639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 785/1552] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.810508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf40f4-9d58-4c22-a5eb-410fd734f934 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:53.811529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 768/1553] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:53.812369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:53.822468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf40f4-9d58-4c22-a5eb-410fd734f934 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:53.876127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c686a04-2a49-497a-8008-3234e2995480 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:53.879043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae10f0-9714-484c-9c9f-8666946acf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:53.879738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae10f0-9714-484c-9c9f-8666946acf7d admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.880036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae10f0-9714-484c-9c9f-8666946acf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.880356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae10f0-9714-484c-9c9f-8666946acf7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.880800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b26f5-bfe6-4c00-aa77-3c077e54f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:53.881046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae10f0-9714-484c-9c9f-8666946acf7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:53.881462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b26f5-bfe6-4c00-aa77-3c077e54f339 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.881746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b26f5-bfe6-4c00-aa77-3c077e54f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.882024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b26f5-bfe6-4c00-aa77-3c077e54f339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.882127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-f2ae10f0-9714-484c-9c9f-8666946acf7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:12:53.882127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:12:53.882127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:12:53.883294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b26f5-bfe6-4c00-aa77-3c077e54f339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:53.883903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae10f0-9714-484c-9c9f-8666946acf7d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:53.885228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b26f5-bfe6-4c00-aa77-3c077e54f339 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:53.909472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 786/1554] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:53.910865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92bd4d-cc68-4e72-a72c-73639e8cff07 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.914401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92bd4d-cc68-4e72-a72c-73639e8cff07 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.914559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 769/1555] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:53.914657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92bd4d-cc68-4e72-a72c-73639e8cff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.914747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ffe1d-50ea-4756-a38a-6383b1c3a4b9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.914747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ffe1d-50ea-4756-a38a-6383b1c3a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.914747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ffe1d-50ea-4756-a38a-6383b1c3a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:53.930577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1c92bd4d-cc68-4e72-a72c-73639e8cff07 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.931780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1c92bd4d-cc68-4e72-a72c-73639e8cff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.933924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-257ffe1d-50ea-4756-a38a-6383b1c3a4b9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:53.935093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-257ffe1d-50ea-4756-a38a-6383b1c3a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:53.993080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 787/1556] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.994002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92bd4d-cc68-4e72-a72c-73639e8cff07 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:53.994197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 770/1557] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:53.995424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123dac5-ecbe-485f-83b4-5274f4c44c99 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:53.995724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123dac5-ecbe-485f-83b4-5274f4c44c99 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:53.995995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123dac5-ecbe-485f-83b4-5274f4c44c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.003959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92bd4d-cc68-4e72-a72c-73639e8cff07 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.009549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.010209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.010494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.010770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.011497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:54.011805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.013442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.022511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8123dac5-ecbe-485f-83b4-5274f4c44c99 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:54.023846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8123dac5-ecbe-485f-83b4-5274f4c44c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:54.025269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 788/1558] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:54.026054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.032213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 771/1559] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:54.037588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ded7ed-e598-488b-9f7e-f5f0eb2e15bf admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.037756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc4f5-9a80-4268-804e-cb2baf296907 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.037998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc4f5-9a80-4268-804e-cb2baf296907 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.039245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc4f5-9a80-4268-804e-cb2baf296907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.043010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.043668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.043952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.044259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.044948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.046796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:54.046935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.059706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d4bbc4f5-9a80-4268-804e-cb2baf296907 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:54.061042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d4bbc4f5-9a80-4268-804e-cb2baf296907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:54.071325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 789/1560] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.071325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.071566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 772/1561] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:54.071566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc4f5-9a80-4268-804e-cb2baf296907 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.076891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:54.079535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc4f5-9a80-4268-804e-cb2baf296907 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.082858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3993-0ec4-4cbd-9aff-06a5efa8b343 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.084569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cc58d-47e5-408b-8420-03b705a72db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.085231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc58d-47e5-408b-8420-03b705a72db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.085511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc58d-47e5-408b-8420-03b705a72db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.085790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cc58d-47e5-408b-8420-03b705a72db4 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.086483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cc58d-47e5-408b-8420-03b705a72db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.087508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-f37cc58d-47e5-408b-8420-03b705a72db4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:12:54.087508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 16 21:12:54.087508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: Jun 16 21:12:54.088460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.088741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cc58d-47e5-408b-8420-03b705a72db4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.089151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.089472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.089751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.090436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.092377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.109840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 773/1562] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.111094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f7062-f4da-48bd-9642-b2f1f3ba11f2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.111395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f7062-f4da-48bd-9642-b2f1f3ba11f2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.111676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f7062-f4da-48bd-9642-b2f1f3ba11f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.119142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 790/1563] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.120263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.129578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063f286-5fc7-4b82-ba79-82984ff7ee6a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.133833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2d2f7062-f4da-48bd-9642-b2f1f3ba11f2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:54.134136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb363-2360-49a1-8515-3538f27216bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.134780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb363-2360-49a1-8515-3538f27216bf admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.135044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2d2f7062-f4da-48bd-9642-b2f1f3ba11f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:54.135152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb363-2360-49a1-8515-3538f27216bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.135327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb363-2360-49a1-8515-3538f27216bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.136044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb363-2360-49a1-8515-3538f27216bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:54.136381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb363-2360-49a1-8515-3538f27216bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.137965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fb363-2360-49a1-8515-3538f27216bf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.143073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 774/1564] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:54.143832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f7062-f4da-48bd-9642-b2f1f3ba11f2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.158990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 791/1565] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:54.159185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f7062-f4da-48bd-9642-b2f1f3ba11f2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.159303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44699-66f0-4b23-809d-2220b316dfca None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.159303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44699-66f0-4b23-809d-2220b316dfca None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.159303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f44699-66f0-4b23-809d-2220b316dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.164025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.164735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.165010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.165285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.165975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.167886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.172052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f1f44699-66f0-4b23-809d-2220b316dfca None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:54.173282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f1f44699-66f0-4b23-809d-2220b316dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:54.181369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 792/1566] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:54.182150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44699-66f0-4b23-809d-2220b316dfca None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.191327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f44699-66f0-4b23-809d-2220b316dfca None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.193497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 775/1567] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.194317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.197074 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.197999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.198339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.198585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.199293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.200935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.213967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 793/1568] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:54.213967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.222859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6496b-b72e-49f3-a4ac-64f31291bec4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.259715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599360a7-ba18-4c2c-b15e-39f55884e7f5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.264422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.265090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.265378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.265655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.266375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:54.266685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.268336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.278311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.278973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.279265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.279540 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.280297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.281337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 776/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:54.281897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.282279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.292724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 794/1570] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:54.293460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.298782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c9f7a-e054-4588-a78f-9be98844f511 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.302712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de7ab4-3aba-4aca-bc7b-6c4eaaa3dbb6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.303394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.304045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.305059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.305532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.306313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.307896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.307999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.308572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.308858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.309138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.309848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:54.310153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.311722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.317758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 777/1571] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:54.317758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.331341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 795/1572] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:54.331341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.331603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2186e-ff31-4d68-84b2-0ef9da3f140d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.332637 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.333276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.333555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.333826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.334494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.337064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.337211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b19bc-f684-41d2-a021-f5d239550960 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.341817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.342466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.342746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.343018 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.343733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:12:54.344039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.345647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.358158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 796/1573] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:12:54.359287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.368336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 778/1574] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.369517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.375282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28ff07-7e8b-4e11-8791-3d222ec9bd3c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.431887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.432417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9ac21-e3ce-497f-89d7-1bb569a10fcd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.432964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.432964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.433143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.433709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.435612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.436944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.437597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.437876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.438153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.438867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.440461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.452419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 779/1575] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:54.453014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.457758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 797/1576] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.458553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.465349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f166488-ded0-4c10-872d-ad1fc085bdde admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.469709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90904ac-41ff-41ae-84e8-2a4d0b2ad2e0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.470106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.470751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.471037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.471309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.472140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.474092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.474377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.475026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.475308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.475583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.476461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.478026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.478454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:54.489241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 798/1577] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:54.490050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.497284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:54.502628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd8cf3-da95-4cdf-bb30-04a4a40ca887 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.503430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 780/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.504591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.562857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.563529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.563809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.564085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.564827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.566414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.569769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb511ee-8cb1-4732-b1a0-88d43a18e49f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.574774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.575431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.575710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.576007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.576382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 799/1579] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:54.576728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.577182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.578620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.586930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd3149-040a-4ec9-af98-dff115487ea1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.591927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.592670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.592951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.593225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.593904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.595778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.612065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 781/1580] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.612880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.625846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 800/1581] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.626512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.679899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f49b4-84fa-4720-9f24-b680e08a0076 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.684665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.685288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.685573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.685879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.686571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.686934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7abf60-bd2b-4ac2-a3d5-366d4a2002ca admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.688532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.691543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.692467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.692749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.693027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] PATH_INFO: `/v3/projects/87f4749861b548a6808e215ab16497d9/users/26922cee7b794e0ca8cec43b6f5daff2/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.707840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f4749861b548a6808e215ab16497d9, user_id=26922cee7b794e0ca8cec43b6f5daff2, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.712621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 782/1582] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.712770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:12:54.712770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:12:54.712770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:12:54.713055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.713143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.720519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa463111-9c53-406b-95e2-4e84b00ec40a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.725098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 801/1583] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:54 2022] PUT /identity/v3/projects/87f4749861b548a6808e215ab16497d9/users/26922cee7b794e0ca8cec43b6f5daff2/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:54.729058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.777809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.778479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.778759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.779028 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.779739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.781366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.783352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:54.788282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bac2d9-5653-4477-adeb-850acfd4892e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.793321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 783/1584] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:54.794180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.794339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.795455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.795969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.796454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] PATH_INFO: `/v3/projects/fdc119fbe54e4bbfa0e0c791d70a1275/users/dfbaaf40d04d4853af55973301b68d65/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.798875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:54.804226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61f5cd-e4e5-4760-8b53-a4edb979b312 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.812386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.813043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.813323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.813599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.814277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.814439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc119fbe54e4bbfa0e0c791d70a1275, user_id=dfbaaf40d04d4853af55973301b68d65, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.816196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.817345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.831933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 802/1585] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:54 2022] PUT /identity/v3/projects/fdc119fbe54e4bbfa0e0c791d70a1275/users/dfbaaf40d04d4853af55973301b68d65/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:54.832911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.853033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 784/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.855005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.865182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a8d5c4-d45a-4fa7-b9c3-e979c14895ec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.898577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e982d-e485-404b-b4bd-c35dfaa1d526 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:54.903368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.904294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.904583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.904866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] PATH_INFO: `/v3/projects/f22cbeb1402848dbb84a5718dca357e1/users/2cb12a51b62c48ba95be62f167b7314e/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.919447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22cbeb1402848dbb84a5718dca357e1, user_id=2cb12a51b62c48ba95be62f167b7314e, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.921303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:54.922061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:54.922180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.922342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:54.922611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:54.923288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:54.925235 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:54.935021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 803/1587] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:54 2022] PUT /identity/v3/projects/f22cbeb1402848dbb84a5718dca357e1/users/2cb12a51b62c48ba95be62f167b7314e/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:54.935768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.949265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 785/1588] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:54.950079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:54.959511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3f87-f372-428e-bc14-e84c3846be4c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.001338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32ac07-920b-42ed-8c5b-aa3721ffe4fd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.006440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbba482-fbb8-4c58-b055-eba780080c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.007118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbba482-fbb8-4c58-b055-eba780080c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.007956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbba482-fbb8-4c58-b055-eba780080c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.008503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbba482-fbb8-4c58-b055-eba780080c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.009218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbba482-fbb8-4c58-b055-eba780080c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.011154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbba482-fbb8-4c58-b055-eba780080c89 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.016771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.017464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.017744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.018017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.018905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.020732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.034056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 804/1589] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:54 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:55.034256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 786/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.034379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ed090-b9a1-41d3-8604-e51385568e3c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.034379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ed090-b9a1-41d3-8604-e51385568e3c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.034563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.034661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ed090-b9a1-41d3-8604-e51385568e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.044400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0debf-45a5-4717-bd68-6f5d6b28b9a2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.049342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.049990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.050274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.050548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.051056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-eb4ed090-b9a1-41d3-8604-e51385568e3c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.051264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.052336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eb4ed090-b9a1-41d3-8604-e51385568e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.052928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.060344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 805/1591] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:55.061711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380a68-ad7f-4f91-a12c-b7c4e4b5bb33 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.062001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380a68-ad7f-4f91-a12c-b7c4e4b5bb33 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.062270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380a68-ad7f-4f91-a12c-b7c4e4b5bb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.066733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 787/1592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.067603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.079203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453c174-bb87-45bd-9395-8cf2319e7ba6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.083932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7589b-7824-4747-a635-91d1165cf140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.084626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7589b-7824-4747-a635-91d1165cf140 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.084936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7589b-7824-4747-a635-91d1165cf140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.085211 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7589b-7824-4747-a635-91d1165cf140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.086520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7589b-7824-4747-a635-91d1165cf140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.088115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7589b-7824-4747-a635-91d1165cf140 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.089971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-83380a68-ad7f-4f91-a12c-b7c4e4b5bb33 None None] MFA Rules not processed for user `dfbaaf40d04d4853af55973301b68d65`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.091180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-83380a68-ad7f-4f91-a12c-b7c4e4b5bb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.098119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 788/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.099336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c496d2-4b61-442f-b45e-2b9b85455517 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.099627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c496d2-4b61-442f-b45e-2b9b85455517 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.099903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c496d2-4b61-442f-b45e-2b9b85455517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.118071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-85c496d2-4b61-442f-b45e-2b9b85455517 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.119292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-85c496d2-4b61-442f-b45e-2b9b85455517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.126934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 789/1594] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:55.130283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:55.130758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c496d2-4b61-442f-b45e-2b9b85455517 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.142665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c496d2-4b61-442f-b45e-2b9b85455517 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.147180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.148232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.148520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.148792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.149518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.151102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.164542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 806/1595] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:55.164721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 790/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.164842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380a68-ad7f-4f91-a12c-b7c4e4b5bb33 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.164938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.174727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380a68-ad7f-4f91-a12c-b7c4e4b5bb33 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.175179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea65a68-d26c-446b-92b3-66a674164601 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.180244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.180493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.181053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.181179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.181340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.181454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.181609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.181707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.182340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.182441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.184130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.184337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.198429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 807/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.198429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.198741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 791/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.199782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.209117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176267e1-5204-4a17-9b8d-a3482b3fc90a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.214682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.215572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.215854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.216126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] PATH_INFO: `/v3/projects/b850a1073cc848b5b21f2a38a7bf4d4d/users/d997f59545bb460194223b0bece2e50e/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.220666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:55.231375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b850a1073cc848b5b21f2a38a7bf4d4d, user_id=d997f59545bb460194223b0bece2e50e, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.234322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.251120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 808/1599] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:55 2022] PUT /identity/v3/projects/b850a1073cc848b5b21f2a38a7bf4d4d/users/d997f59545bb460194223b0bece2e50e/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:55.251120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.265445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cb2df-6467-46f4-9194-b841a43495eb admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.310017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe44970-9dbc-4b1a-a75c-b398f28b673e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.314195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.314724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.314844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.315105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.315368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.315473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.315662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.315947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.316700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.318296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.325005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.326491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.328542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 809/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.329353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.338205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 792/1601] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:55.339012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.339454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc146d3-7d42-4c88-8ffa-ca8acb50c71c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.343118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.343752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.344149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.344393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.348594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b65b9-0501-452a-a546-63256bfee907 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.353005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab9a48-5339-48f1-af76-60852b5cd5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.353733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9a48-5339-48f1-af76-60852b5cd5df admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.354019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9a48-5339-48f1-af76-60852b5cd5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.354293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9a48-5339-48f1-af76-60852b5cd5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.355007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab9a48-5339-48f1-af76-60852b5cd5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.356535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.356675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab9a48-5339-48f1-af76-60852b5cd5df admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.357963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.367705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 793/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.369106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103b40-b2dd-400c-9598-232e75e82372 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.369398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103b40-b2dd-400c-9598-232e75e82372 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.369730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103b40-b2dd-400c-9598-232e75e82372 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.370659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 810/1603] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:55.371750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 794/1604] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 16 21:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:12:55.371854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.371943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87103b40-b2dd-400c-9598-232e75e82372 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.381826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d909e8a-7d15-4d7e-ad05-2c6ea84312a0 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.385490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87103b40-b2dd-400c-9598-232e75e82372 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.387537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a8e94-1ba9-4734-b45e-0fcd89775611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.388241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a8e94-1ba9-4734-b45e-0fcd89775611 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.388548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a8e94-1ba9-4734-b45e-0fcd89775611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.388806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a8e94-1ba9-4734-b45e-0fcd89775611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.389531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a8e94-1ba9-4734-b45e-0fcd89775611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.390957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.391180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a8e94-1ba9-4734-b45e-0fcd89775611 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.391841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.392296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.392666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] PATH_INFO: `/v3/projects/dae1eddc6c814d689d18b54b13bd8970/users/0d676c1575cb4e319f11a365c14e0de3/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.402866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 811/1605] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:55.404166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fd6ae-0a4c-489b-a2bf-2ddb94c9764d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.404520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fd6ae-0a4c-489b-a2bf-2ddb94c9764d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.404819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880fd6ae-0a4c-489b-a2bf-2ddb94c9764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.411417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae1eddc6c814d689d18b54b13bd8970, user_id=0d676c1575cb4e319f11a365c14e0de3, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.414638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.425458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-880fd6ae-0a4c-489b-a2bf-2ddb94c9764d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.426890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-880fd6ae-0a4c-489b-a2bf-2ddb94c9764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.431280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 795/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:55 2022] PUT /identity/v3/projects/dae1eddc6c814d689d18b54b13bd8970/users/0d676c1575cb4e319f11a365c14e0de3/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:55.432283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.501975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45230a6-1c95-4a81-96f0-a533527903f1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.507808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54849f2e-22c7-4277-abef-c61855e8769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.508713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849f2e-22c7-4277-abef-c61855e8769a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.508995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849f2e-22c7-4277-abef-c61855e8769a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.509271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849f2e-22c7-4277-abef-c61855e8769a admin admin] PATH_INFO: `/v3/projects/536b36bd517a4dca8706718f6bab9c1a/users/9c13ce02fca548c5b1186a536a2d4474/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.513713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 812/1607] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:55.513713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fd6ae-0a4c-489b-a2bf-2ddb94c9764d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.523680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880fd6ae-0a4c-489b-a2bf-2ddb94c9764d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.528702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.529739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.530046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.530317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] PATH_INFO: `/v3/projects/132f4f9e80f54d40a439a40fd74ff3a7/users/fea40c33d3564ec1883e2ee441808b60/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.534924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54849f2e-22c7-4277-abef-c61855e8769a admin admin] RBAC: Authorizing `identity:create_grant(project_id=536b36bd517a4dca8706718f6bab9c1a, user_id=9c13ce02fca548c5b1186a536a2d4474, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.537729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54849f2e-22c7-4277-abef-c61855e8769a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.550040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:55.553757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=132f4f9e80f54d40a439a40fd74ff3a7, user_id=fea40c33d3564ec1883e2ee441808b60, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.554332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 796/1608] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:55 2022] PUT /identity/v3/projects/536b36bd517a4dca8706718f6bab9c1a/users/9c13ce02fca548c5b1186a536a2d4474/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:55.556256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a33aa6-9079-462c-9106-b32c5b6062e5 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.556807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a33aa6-9079-462c-9106-b32c5b6062e5 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.557366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a33aa6-9079-462c-9106-b32c5b6062e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.557467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.574466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 813/1609] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:55 2022] PUT /identity/v3/projects/132f4f9e80f54d40a439a40fd74ff3a7/users/fea40c33d3564ec1883e2ee441808b60/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:55.575748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.580336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e6a33aa6-9079-462c-9106-b32c5b6062e5 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.581667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6a33aa6-9079-462c-9106-b32c5b6062e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.615054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:55.646500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7793b0-8a7c-450a-a584-398a0f5699f6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.652584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.653499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.653924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.654230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] PATH_INFO: `/v3/projects/8fd2e5ab99c341d38c3f78dc17c0faf2/users/8cc395fc4407473e9595bc99c6b6b36c/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.673126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2e5ab99c341d38c3f78dc17c0faf2, user_id=8cc395fc4407473e9595bc99c6b6b36c, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.677661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.686228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 797/1610] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:55.687887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8e46-56a9-4107-80ec-cd32bff6bf47 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.688224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8e46-56a9-4107-80ec-cd32bff6bf47 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.688506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac8e46-56a9-4107-80ec-cd32bff6bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.704361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 814/1611] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:55 2022] PUT /identity/v3/projects/8fd2e5ab99c341d38c3f78dc17c0faf2/users/8cc395fc4407473e9595bc99c6b6b36c/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:55.704361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.706726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.723287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-00ac8e46-56a9-4107-80ec-cd32bff6bf47 None None] MFA Rules not processed for user `0d676c1575cb4e319f11a365c14e0de3`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.724558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-00ac8e46-56a9-4107-80ec-cd32bff6bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.772415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e4083-a7d0-47fa-8404-4c3e1662f5ab admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:55.779062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204077e-3617-469f-8a18-494e99aa6514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:55.782410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204077e-3617-469f-8a18-494e99aa6514 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.784023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204077e-3617-469f-8a18-494e99aa6514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.784744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204077e-3617-469f-8a18-494e99aa6514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.805351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 798/1612] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:55.807176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ad93-e20a-4b41-9714-8bc7d3999384 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.807468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ad93-e20a-4b41-9714-8bc7d3999384 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.808028 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50ad93-e20a-4b41-9714-8bc7d3999384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.829046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ab50ad93-e20a-4b41-9714-8bc7d3999384 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.830344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ab50ad93-e20a-4b41-9714-8bc7d3999384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.871434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204077e-3617-469f-8a18-494e99aa6514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:55.872902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204077e-3617-469f-8a18-494e99aa6514 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:55.883072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 815/1613] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:55.884444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ac19-c41b-407b-a301-6e6315bbd96c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:55.887907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ac19-c41b-407b-a301-6e6315bbd96c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:55.887907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27ac19-c41b-407b-a301-6e6315bbd96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:55.921602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cc27ac19-c41b-407b-a301-6e6315bbd96c None None] MFA Rules not processed for user `fea40c33d3564ec1883e2ee441808b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:55.923020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc27ac19-c41b-407b-a301-6e6315bbd96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:55.932889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 799/1614] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:55.934608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ad93-e20a-4b41-9714-8bc7d3999384 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:55.941663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:56.007199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:56.025535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 816/1615] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:56.027073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377f58-0c6a-4aad-96c4-be47fa960e2c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.027368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377f58-0c6a-4aad-96c4-be47fa960e2c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.027645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42377f58-0c6a-4aad-96c4-be47fa960e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.050807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-42377f58-0c6a-4aad-96c4-be47fa960e2c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:56.052371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-42377f58-0c6a-4aad-96c4-be47fa960e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:56.052856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50ad93-e20a-4b41-9714-8bc7d3999384 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:56.063800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 817/1616] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:56.065229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42377f58-0c6a-4aad-96c4-be47fa960e2c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:56.067661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3453368-d071-466d-9993-b8f3e0a20143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:56.068425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453368-d071-466d-9993-b8f3e0a20143 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.068709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453368-d071-466d-9993-b8f3e0a20143 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.068987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3453368-d071-466d-9993-b8f3e0a20143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.156627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42377f58-0c6a-4aad-96c4-be47fa960e2c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:56.161406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:56.162124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.162926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.163225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.176916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:56.186307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:56.197583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453368-d071-466d-9993-b8f3e0a20143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:56.200854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3453368-d071-466d-9993-b8f3e0a20143 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:56.213055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 818/1617] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:56.214732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:56.229085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 800/1618] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:56.231868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab03c0-7cc7-4677-8ae9-9d10ad61ceb0 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:56.233127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb3fd-d822-40fe-8909-dbce0dc3a453 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.233426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb3fd-d822-40fe-8909-dbce0dc3a453 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.233975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88beb3fd-d822-40fe-8909-dbce0dc3a453 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.237324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf2261-aa20-469e-8b58-0e2fc6be4c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:56.238643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf2261-aa20-469e-8b58-0e2fc6be4c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.238979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 801/1619] 10.222.0.43 () {54 vars in 961 bytes} [Thu Jun 16 21:12:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:12:56.239365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf2261-aa20-469e-8b58-0e2fc6be4c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.239854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf2261-aa20-469e-8b58-0e2fc6be4c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.240039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb3fd-d822-40fe-8909-dbce0dc3a453 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:56.252748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf2261-aa20-469e-8b58-0e2fc6be4c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:56.256409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf2261-aa20-469e-8b58-0e2fc6be4c22 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:56.266921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88beb3fd-d822-40fe-8909-dbce0dc3a453 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:56.271686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894c8a1-7598-4501-b771-6bdaca469c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:56.272457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 819/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:56.272588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c8a1-7598-4501-b771-6bdaca469c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.273700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c8a1-7598-4501-b771-6bdaca469c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.273996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894c8a1-7598-4501-b771-6bdaca469c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.275752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb853cf-040e-4243-b18a-21641c08f81c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.276320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb853cf-040e-4243-b18a-21641c08f81c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.276858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb853cf-040e-4243-b18a-21641c08f81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.299770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4fb853cf-040e-4243-b18a-21641c08f81c None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:56.300247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894c8a1-7598-4501-b771-6bdaca469c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:56.301281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4fb853cf-040e-4243-b18a-21641c08f81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:56.302935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894c8a1-7598-4501-b771-6bdaca469c9b service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:56.316264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 820/1621] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Jun 16 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:56.328223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 802/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:56.332809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb853cf-040e-4243-b18a-21641c08f81c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:56.367973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb853cf-040e-4243-b18a-21641c08f81c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:56.383755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff024e3-5405-4aef-b290-4f5947882a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:56.384619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff024e3-5405-4aef-b290-4f5947882a9f service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.385604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff024e3-5405-4aef-b290-4f5947882a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.385923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff024e3-5405-4aef-b290-4f5947882a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.406674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff024e3-5405-4aef-b290-4f5947882a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:56.409300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff024e3-5405-4aef-b290-4f5947882a9f service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:56.435806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 821/1623] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:56.751928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ba76-f1a3-43b0-82ef-350d45ae39cf None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.752491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ba76-f1a3-43b0-82ef-350d45ae39cf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.752491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c7ba76-f1a3-43b0-82ef-350d45ae39cf None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.753878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 803/1624] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 16 21:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:12:56.762251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5dcea-55ed-4a0c-af49-6e891ecdfb0b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.762536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5dcea-55ed-4a0c-af49-6e891ecdfb0b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.762850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5dcea-55ed-4a0c-af49-6e891ecdfb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.765801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9eb3f-c071-4bd2-adc6-88de4e2de592 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.766090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9eb3f-c071-4bd2-adc6-88de4e2de592 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.766393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df9eb3f-c071-4bd2-adc6-88de4e2de592 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.768265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 804/1625] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 16 21:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:12:56.776992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1f89-5abb-473a-96d1-c647f25dc5b2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.777292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1f89-5abb-473a-96d1-c647f25dc5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.777668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1f89-5abb-473a-96d1-c647f25dc5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.795812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-aac5dcea-55ed-4a0c-af49-6e891ecdfb0b None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:56.798590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-aac5dcea-55ed-4a0c-af49-6e891ecdfb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:56.823757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 822/1626] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:56.844293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5dcea-55ed-4a0c-af49-6e891ecdfb0b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:56.846048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-731d1f89-5abb-473a-96d1-c647f25dc5b2 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:56.850222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-731d1f89-5abb-473a-96d1-c647f25dc5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:56.867567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5dcea-55ed-4a0c-af49-6e891ecdfb0b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:56.875642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e3a85-d068-4fd6-8e6c-f8b5d03089f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:56.876447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e3a85-d068-4fd6-8e6c-f8b5d03089f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:56.879269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e3a85-d068-4fd6-8e6c-f8b5d03089f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:56.879568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e3a85-d068-4fd6-8e6c-f8b5d03089f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:56.891683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 805/1627] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:12:56.907990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e3a85-d068-4fd6-8e6c-f8b5d03089f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:56.912256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e3a85-d068-4fd6-8e6c-f8b5d03089f9 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:56.988910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 823/1628] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:57.069571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1f89-5abb-473a-96d1-c647f25dc5b2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:57.083608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1f89-5abb-473a-96d1-c647f25dc5b2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:57.092559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:57.093831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:57.095738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:57.096210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:57.128388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:57.131904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:57.174687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 806/1629] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:12:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:12:58.225836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034951e6-abf5-406d-a6a1-06649eac587f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:58.225836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034951e6-abf5-406d-a6a1-06649eac587f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:58.225836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034951e6-abf5-406d-a6a1-06649eac587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:58.258679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-034951e6-abf5-406d-a6a1-06649eac587f None None] MFA Rules not processed for user `d997f59545bb460194223b0bece2e50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:12:58.260167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-034951e6-abf5-406d-a6a1-06649eac587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:12:58.372053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:12:58.402003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 824/1630] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:12:58 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:12:58.406491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:58.426563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d6b69-d956-4a27-ba97-20e4e981b3ca service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:58.433832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:58.434696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:58.435039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:58.435573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:58.436439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:58.438863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:58.484768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 807/1631] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:12:58 2022] POST /identity/v3/projects => generated 403 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:58.486364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034951e6-abf5-406d-a6a1-06649eac587f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:58.501889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034951e6-abf5-406d-a6a1-06649eac587f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:58.582000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:58.584107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:58.584645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:58.584881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:58.586170 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:58.588648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:58.641524 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 825/1632] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:12:58 2022] POST /identity/v3/users => generated 308 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:12:58.645910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:58.660815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2220-0b2f-4630-9527-59d4c6c88294 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:58.670498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:58.671462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:58.672396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:58.672396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:58.688500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:58.693436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:58.721454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 808/1633] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:58.722971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:58.737708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca4b08-f9dd-432e-bed7-ae2dc91ad8c5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:58.744844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:58.745923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:58.746473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:58.746816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] PATH_INFO: `/v3/projects/d5223955c846440693dd84ca102dea73/users/89f86b3a6dd9470f80a2053416a16ebb/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:58.781636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5223955c846440693dd84ca102dea73, user_id=89f86b3a6dd9470f80a2053416a16ebb, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:58.784514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:58.820990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 826/1634] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:58 2022] PUT /identity/v3/projects/d5223955c846440693dd84ca102dea73/users/89f86b3a6dd9470f80a2053416a16ebb/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:12:58.822957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:58.839973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db8faa-628c-4f43-af04-5d0b6a48660a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:58.948912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f238fc6-3ce5-4879-9108-40e3a698eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:58.950613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fc6-3ce5-4879-9108-40e3a698eba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:58.952081 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fc6-3ce5-4879-9108-40e3a698eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:58.952696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f238fc6-3ce5-4879-9108-40e3a698eba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:58.954642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fc6-3ce5-4879-9108-40e3a698eba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:58.957444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f238fc6-3ce5-4879-9108-40e3a698eba5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:58.974109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 809/1635] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:12:58.978562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:12:58.995279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df67dfe-889f-458e-b98e-41faa2df3748 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:12:59.002986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:12:59.004374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:12:59.005102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:12:59.005641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] PATH_INFO: `/v3/projects/d5223955c846440693dd84ca102dea73/users/89f86b3a6dd9470f80a2053416a16ebb/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:12:59.009047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5223955c846440693dd84ca102dea73, user_id=89f86b3a6dd9470f80a2053416a16ebb, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:12:59.012886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:12:59.032730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 827/1636] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:12:58 2022] PUT /identity/v3/projects/d5223955c846440693dd84ca102dea73/users/89f86b3a6dd9470f80a2053416a16ebb/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:02.651003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e345db-2939-4156-a68b-8f7771e15adf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:02.651478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e345db-2939-4156-a68b-8f7771e15adf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:02.651566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e345db-2939-4156-a68b-8f7771e15adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:02.705165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:02.738682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c7e345db-2939-4156-a68b-8f7771e15adf None None] MFA Rules not processed for user `89f86b3a6dd9470f80a2053416a16ebb`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:02.742795 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c7e345db-2939-4156-a68b-8f7771e15adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:02.911937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 810/1637] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:02 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:04.621177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:04.781332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e3830-9a8d-4c70-b294-5f0ba50f24ca admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:04.793598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:04.794649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:04.795111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:04.795662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] PATH_INFO: `/v3/users/dfbaaf40d04d4853af55973301b68d65` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:04.799483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfbaaf40d04d4853af55973301b68d65)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:04.800559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: WARNING py.warnings [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:13:04.800559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: warnings.warn(msg) Jun 16 21:13:04.800559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: Jun 16 21:13:04.805100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:04.998441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:05.037013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfbaaf40d04d4853af55973301b68d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:05.037769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfbaaf40d04d4853af55973301b68d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:05.038427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfbaaf40d04d4853af55973301b68d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:05.094102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfbaaf40d04d4853af55973301b68d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:05.125622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfbaaf40d04d4853af55973301b68d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:05.159089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 828/1638] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:04 2022] DELETE /identity/v3/users/dfbaaf40d04d4853af55973301b68d65 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:05.160904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:05.161380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:05.161665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:05.222985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:05.232216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:05.415867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 811/1639] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:05.457966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:05.459687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:05.588420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00934b0-e939-4e06-a7d3-26db8ee2d679 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:05.601200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553925aa-9e30-4e0d-9a5d-2484c77acabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:05.601888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553925aa-9e30-4e0d-9a5d-2484c77acabd service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:05.602180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553925aa-9e30-4e0d-9a5d-2484c77acabd service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:05.602464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553925aa-9e30-4e0d-9a5d-2484c77acabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:05.626145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553925aa-9e30-4e0d-9a5d-2484c77acabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:05.627629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553925aa-9e30-4e0d-9a5d-2484c77acabd service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:05.658397 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 829/1640] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:06.607329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:06.609034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:06.646201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd189b-19ba-4e86-a2bf-a89935edc8dc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:06.675409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:06.676382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:06.676669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:06.676949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] PATH_INFO: `/v3/users/fea40c33d3564ec1883e2ee441808b60` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:06.684861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea40c33d3564ec1883e2ee441808b60)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:06.692519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:06.700874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9373-abb1-49f6-be65-6b675d621dca None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:06.701732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9373-abb1-49f6-be65-6b675d621dca None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:06.702183 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9373-abb1-49f6-be65-6b675d621dca None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:06.704004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 830/1641] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:13:06.748495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fcefe-eb63-4820-a59e-45cdb0d256a2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:06.749064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fcefe-eb63-4820-a59e-45cdb0d256a2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:06.749522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fcefe-eb63-4820-a59e-45cdb0d256a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:06.800934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-940fcefe-eb63-4820-a59e-45cdb0d256a2 None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:06.802585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-940fcefe-eb63-4820-a59e-45cdb0d256a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:06.807907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea40c33d3564ec1883e2ee441808b60'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:06.809069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea40c33d3564ec1883e2ee441808b60'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:06.810110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea40c33d3564ec1883e2ee441808b60'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:06.843789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea40c33d3564ec1883e2ee441808b60'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:06.872359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-82d1174b-8488-4bf0-b4b6-57814f67748d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea40c33d3564ec1883e2ee441808b60'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:06.901978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 812/1642] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:06 2022] DELETE /identity/v3/users/fea40c33d3564ec1883e2ee441808b60 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:06.905915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:06.906201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:06.906995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:06.955764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:06.961503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:06.972033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:07.028695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 831/1643] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:07.130507 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f172-713d-4608-82a8-53ab90b90219 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:07.131053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f172-713d-4608-82a8-53ab90b90219 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:07.131546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f172-713d-4608-82a8-53ab90b90219 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:07.135094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 832/1644] 10.222.0.43 () {54 vars in 960 bytes} [Thu Jun 16 21:13:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 21:13:07.142617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:07.143206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:07.143690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:07.148943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 813/1645] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:07.203076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:07.205311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:07.209335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:07.211112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:07.328863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d0e53-db47-4f4f-a57c-fc6c3ef94a2f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:07.333092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:07.333965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:07.334388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:07.334820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:07.351737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:07.357521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:07.373692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 814/1646] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:07.393873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:07.407593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 833/1647] 10.222.0.43 () {58 vars in 1057 bytes} [Thu Jun 16 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:07.416715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:07.455510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e313f1-09d3-46cc-948d-9fdee4168c7d service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:07.465441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e84bc-36c8-48d8-89c7-586335a3bbd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:07.493805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e84bc-36c8-48d8-89c7-586335a3bbd1 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:07.495635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e84bc-36c8-48d8-89c7-586335a3bbd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:07.497908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e84bc-36c8-48d8-89c7-586335a3bbd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:07.525485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e84bc-36c8-48d8-89c7-586335a3bbd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:07.528523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e84bc-36c8-48d8-89c7-586335a3bbd1 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:07.557020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 815/1648] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:07.589090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:07.592384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:07.641020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1146120-a569-42c1-aa29-86a00358e057 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:07.647459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:07.648435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:07.648772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:07.649050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] PATH_INFO: `/v3/projects/fdc119fbe54e4bbfa0e0c791d70a1275` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:07.650457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc119fbe54e4bbfa0e0c791d70a1275)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:07.652984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:07.789273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc119fbe54e4bbfa0e0c791d70a1275', 'request_id': 'req-476a3824-4856-4e2c-aa86-68c0f33485a0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:07.805916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc119fbe54e4bbfa0e0c791d70a1275', 'request_id': 'req-476a3824-4856-4e2c-aa86-68c0f33485a0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:07.825548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc119fbe54e4bbfa0e0c791d70a1275', 'request_id': 'req-476a3824-4856-4e2c-aa86-68c0f33485a0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:07.845284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] The token cache is being invalidate because project fdc119fbe54e4bbfa0e0c791d70a1275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:07.846480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:07.847803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-476a3824-4856-4e2c-aa86-68c0f33485a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:07.852568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 834/1649] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:07 2022] DELETE /identity/v3/projects/fdc119fbe54e4bbfa0e0c791d70a1275 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:07.855581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bb18a-575b-4bf8-a619-9e567ab278d9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:07.856458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bb18a-575b-4bf8-a619-9e567ab278d9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:07.858091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bb18a-575b-4bf8-a619-9e567ab278d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:07.898820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-235bb18a-575b-4bf8-a619-9e567ab278d9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:07.900480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-235bb18a-575b-4bf8-a619-9e567ab278d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:08.003817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 816/1650] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:08.012100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af364d0-b23b-4e06-b0b6-62a36d8f08a4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.012420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af364d0-b23b-4e06-b0b6-62a36d8f08a4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.012702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af364d0-b23b-4e06-b0b6-62a36d8f08a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.049834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4af364d0-b23b-4e06-b0b6-62a36d8f08a4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:08.051112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4af364d0-b23b-4e06-b0b6-62a36d8f08a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:08.070578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 835/1651] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:08.072990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bb18a-575b-4bf8-a619-9e567ab278d9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:08.086706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bb18a-575b-4bf8-a619-9e567ab278d9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:08.134955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:08.137748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.138039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.138319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.139093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:08.139407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:08.141085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:08.188301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 817/1652] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:08.193949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af364d0-b23b-4e06-b0b6-62a36d8f08a4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:08.219376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af364d0-b23b-4e06-b0b6-62a36d8f08a4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:08.236959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:08.238252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.239720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.240199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.241313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:08.247219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:08.314441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 836/1653] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:08 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:08.320936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:08.342987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c34db-0850-45b7-92db-72a7271f08d9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:08.426815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:08.511160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:08.511503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.512577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.512877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.515729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:08.518203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:08.564004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 818/1654] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:08 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:08.564714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:08.594945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adba503-316c-4e27-b9dd-7d61acd40653 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:08.624168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:08.625092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.625338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.627012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.627012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:08.628649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:08.661490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 837/1655] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:08.663042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:08.698154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faaed3-29a4-4a48-a5c6-2dac4d9617a3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:08.710061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593073af-d1ed-49aa-bd61-bb18832ee3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:08.712803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593073af-d1ed-49aa-bd61-bb18832ee3b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.713355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593073af-d1ed-49aa-bd61-bb18832ee3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.713715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593073af-d1ed-49aa-bd61-bb18832ee3b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.714549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593073af-d1ed-49aa-bd61-bb18832ee3b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:08.718957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593073af-d1ed-49aa-bd61-bb18832ee3b9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:08.746372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:08.746568 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 819/1656] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:08.760554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48742a3d-2d76-4a7f-bd42-cc2a94b87021 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:08.775919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bb04a-9fe3-4b63-82fd-13fac4eeb646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:08.777115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb04a-9fe3-4b63-82fd-13fac4eeb646 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.778300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb04a-9fe3-4b63-82fd-13fac4eeb646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.778785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bb04a-9fe3-4b63-82fd-13fac4eeb646 admin admin] PATH_INFO: `/v3/projects/a312ecab6f8241c1b7622221e2b0d917/users/a4d8bdfd1882490db52e290e5237d71b/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.814999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bb04a-9fe3-4b63-82fd-13fac4eeb646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a312ecab6f8241c1b7622221e2b0d917, user_id=a4d8bdfd1882490db52e290e5237d71b, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:08.818988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bb04a-9fe3-4b63-82fd-13fac4eeb646 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:08.844586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794adcec-056f-47cc-9136-5786cf2e756f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.844995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794adcec-056f-47cc-9136-5786cf2e756f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.845446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794adcec-056f-47cc-9136-5786cf2e756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.857048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 838/1657] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:08 2022] PUT /identity/v3/projects/a312ecab6f8241c1b7622221e2b0d917/users/a4d8bdfd1882490db52e290e5237d71b/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:08.868191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:08.869010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:08.869475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:08.922918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-794adcec-056f-47cc-9136-5786cf2e756f None None] MFA Rules not processed for user `8cc395fc4407473e9595bc99c6b6b36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:08.935646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-794adcec-056f-47cc-9136-5786cf2e756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:08.950059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] MFA Rules not processed for user `a4d8bdfd1882490db52e290e5237d71b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:08.951857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:09.072270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 820/1658] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:09.089455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 839/1659] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:09.095566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794adcec-056f-47cc-9136-5786cf2e756f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:09.097246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:09.098802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:09.110772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:09.249498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794adcec-056f-47cc-9136-5786cf2e756f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:09.277196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:09.281121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:09.281451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:09.281738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:09.282473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:09.284459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:09.287978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e70b14-8140-4f1d-9a6d-d4f1f02a492a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:09.301869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:09.302950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:09.303548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:09.304223 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:09.317708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:09.320277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:09.341474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 840/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:13:09.407138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:09.425571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f0563-f105-4a0b-9cec-e49b78848a3c service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:09.437553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 821/1661] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:09 2022] POST /identity/v3/projects => generated 363 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:09.603828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:09.606341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:09.606864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:09.607374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:09.608155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:09.611013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:09.696765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 841/1662] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:09 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:09.698281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:09.738845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d0e11-4ebd-4a82-812a-4bb24cbb9037 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:09.775066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:09.775753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:09.776039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:09.776344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:09.784195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:09.785910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:09.827744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 822/1663] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:09.829511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:09.845021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75a5a5-81c9-45c0-8fef-aa93a66c9dc8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:09.855638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d6d8-cce1-4ced-8cd6-ce51b6e068e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:09.857948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d6d8-cce1-4ced-8cd6-ce51b6e068e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:09.858541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d6d8-cce1-4ced-8cd6-ce51b6e068e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:09.858724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d6d8-cce1-4ced-8cd6-ce51b6e068e7 admin admin] PATH_INFO: `/v3/projects/7c1060efcf034d2d99368666fa90cce4/users/e8dab8d3442b42b0a4ce132306bc8f9f/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:09.883693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d6d8-cce1-4ced-8cd6-ce51b6e068e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1060efcf034d2d99368666fa90cce4, user_id=e8dab8d3442b42b0a4ce132306bc8f9f, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:09.887354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d6d8-cce1-4ced-8cd6-ce51b6e068e7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:09.939424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 842/1664] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:09 2022] PUT /identity/v3/projects/7c1060efcf034d2d99368666fa90cce4/users/e8dab8d3442b42b0a4ce132306bc8f9f/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:09.945300 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:09.958321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33840a-d7d6-4936-b988-6fd9ac341251 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:09.959290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33840a-d7d6-4936-b988-6fd9ac341251 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:09.959290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33840a-d7d6-4936-b988-6fd9ac341251 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:09.966452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 843/1665] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:13:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:13:09.966604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a0cc-a0ca-494a-912b-7ea8fc6bd1c1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:09.978821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:09.991292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:09.991973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:09.991973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.043476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] MFA Rules not processed for user `3f7cc31562ab4ef5a72fadb9b8c98f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:10.048622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:10.102733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:10.103674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:10.103966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:10.104275 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.105606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:10.107859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:10.127884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 823/1666] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:10.130814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:10.153343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a672f5d-59f1-4177-974e-0e4a33ce1f8e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:10.168135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:10.169347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:10.175061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:10.175185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] PATH_INFO: `/v3/projects/7c1060efcf034d2d99368666fa90cce4/users/e8dab8d3442b42b0a4ce132306bc8f9f/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.180760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1060efcf034d2d99368666fa90cce4, user_id=e8dab8d3442b42b0a4ce132306bc8f9f, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:10.183888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:10.208458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:10.217118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 824/1667] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:10 2022] PUT /identity/v3/projects/7c1060efcf034d2d99368666fa90cce4/users/e8dab8d3442b42b0a4ce132306bc8f9f/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:10.227059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:10.228484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:10.269298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 844/1668] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:13:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:10.270695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:10.273745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:10.293138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24329-7697-4e7d-8a44-674c1d2ab91f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:10.347906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2408a-5c93-4a3c-b40b-a965dc8ca78a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:10.356328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:10.357661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:10.358049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:10.358519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] PATH_INFO: `/v3/users/d997f59545bb460194223b0bece2e50e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.373063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d997f59545bb460194223b0bece2e50e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:10.374735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:10.447842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd997f59545bb460194223b0bece2e50e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.449129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd997f59545bb460194223b0bece2e50e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.449654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd997f59545bb460194223b0bece2e50e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.465214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:10.465410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd997f59545bb460194223b0bece2e50e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.466527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:10.469195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:10.469712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] PATH_INFO: `/v3/projects/132f4f9e80f54d40a439a40fd74ff3a7` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.471922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=132f4f9e80f54d40a439a40fd74ff3a7)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:10.475139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:10.480908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-70b52aba-517f-4d84-93be-881e6d86aca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd997f59545bb460194223b0bece2e50e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.524417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 825/1669] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:10 2022] DELETE /identity/v3/users/d997f59545bb460194223b0bece2e50e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:10.540752 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfd650-cffa-4123-87ee-6aa04da0b2ae None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:10.541050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfd650-cffa-4123-87ee-6aa04da0b2ae None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:10.541338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfd650-cffa-4123-87ee-6aa04da0b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.607732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:10.623701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b3bfd650-cffa-4123-87ee-6aa04da0b2ae None None] MFA Rules not processed for user `e8dab8d3442b42b0a4ce132306bc8f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:10.625327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b3bfd650-cffa-4123-87ee-6aa04da0b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:10.697538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '132f4f9e80f54d40a439a40fd74ff3a7', 'request_id': 'req-9297a292-3c14-46cc-b22b-4c6d8ab43480'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.714185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '132f4f9e80f54d40a439a40fd74ff3a7', 'request_id': 'req-9297a292-3c14-46cc-b22b-4c6d8ab43480'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.733363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '132f4f9e80f54d40a439a40fd74ff3a7', 'request_id': 'req-9297a292-3c14-46cc-b22b-4c6d8ab43480'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.759802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] The token cache is being invalidate because project 132f4f9e80f54d40a439a40fd74ff3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:10.761411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.763659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:10.770519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 845/1670] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:10 2022] DELETE /identity/v3/projects/132f4f9e80f54d40a439a40fd74ff3a7 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:10.770519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:10.774969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:10.849836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 826/1671] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:10.850749 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:10.853997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:10.857134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.923285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:10.924555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:10.952598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a292-3c14-46cc-b22b-4c6d8ab43480 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:10.966376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:10.967000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:10.967292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:10.967576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:10.973699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:11.009172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:11.013263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:11.034607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 846/1672] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:11.059102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:11.075811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:11.108452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 827/1673] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:11.109792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:11.113049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:11.140582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:11.146685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be8c16-4c08-4aca-90ae-6e35e379c22d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:11.175379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:11.176894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:11.177188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:11.177469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] PATH_INFO: `/v3/projects/b850a1073cc848b5b21f2a38a7bf4d4d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:11.183214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b850a1073cc848b5b21f2a38a7bf4d4d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:11.184206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: WARNING py.warnings [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 21:13:11.184206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: warnings.warn(msg) Jun 16 21:13:11.184206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: Jun 16 21:13:11.192253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:11.214722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9456e2-6e0c-4546-bbc8-a0022b555690 service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:11.229057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43124e3a-1cf3-4ff1-bee6-6274b0b45654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:11.229752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43124e3a-1cf3-4ff1-bee6-6274b0b45654 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:11.230043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43124e3a-1cf3-4ff1-bee6-6274b0b45654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:11.230324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43124e3a-1cf3-4ff1-bee6-6274b0b45654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:11.354839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b850a1073cc848b5b21f2a38a7bf4d4d', 'request_id': 'req-98f0cfba-ace2-4798-a521-af83fcd9bd54'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.383376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b850a1073cc848b5b21f2a38a7bf4d4d', 'request_id': 'req-98f0cfba-ace2-4798-a521-af83fcd9bd54'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.391660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43124e3a-1cf3-4ff1-bee6-6274b0b45654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:11.393803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43124e3a-1cf3-4ff1-bee6-6274b0b45654 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:11.401170 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b850a1073cc848b5b21f2a38a7bf4d4d', 'request_id': 'req-98f0cfba-ace2-4798-a521-af83fcd9bd54'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.409675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 847/1674] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:11 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:11.415834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d51f-bf8d-41dc-a30c-3d1be8ab3224 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:11.416117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d51f-bf8d-41dc-a30c-3d1be8ab3224 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:11.416706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283d51f-bf8d-41dc-a30c-3d1be8ab3224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:11.420815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] The token cache is being invalidate because project b850a1073cc848b5b21f2a38a7bf4d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:11.421333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.422485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.425654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 828/1675] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:11 2022] DELETE /identity/v3/projects/b850a1073cc848b5b21f2a38a7bf4d4d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:11.430796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:11.434369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:11.468729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e283d51f-bf8d-41dc-a30c-3d1be8ab3224 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:11.469998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e283d51f-bf8d-41dc-a30c-3d1be8ab3224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:11.496646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:11.622943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 848/1676] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:11.624459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364f5dd-12c3-4da5-9690-27b22728ecdd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:11.624746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364f5dd-12c3-4da5-9690-27b22728ecdd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:11.625154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364f5dd-12c3-4da5-9690-27b22728ecdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:11.649730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f0cfba-ace2-4798-a521-af83fcd9bd54 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:11.676654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:11.678477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8364f5dd-12c3-4da5-9690-27b22728ecdd None None] MFA Rules not processed for user `2cb12a51b62c48ba95be62f167b7314e`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:11.679802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8364f5dd-12c3-4da5-9690-27b22728ecdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:11.681563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:11.681901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:11.682193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] PATH_INFO: `/v3/users/89f86b3a6dd9470f80a2053416a16ebb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:11.690328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f86b3a6dd9470f80a2053416a16ebb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:11.692576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:11.795639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:11.858108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 849/1677] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:11.866242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364f5dd-12c3-4da5-9690-27b22728ecdd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:11.873756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f86b3a6dd9470f80a2053416a16ebb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.874525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f86b3a6dd9470f80a2053416a16ebb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.875166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f86b3a6dd9470f80a2053416a16ebb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.893198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364f5dd-12c3-4da5-9690-27b22728ecdd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:11.911289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:11.912281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:11.912574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:11.912968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:11.915105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:11.915562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:11.918556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:11.929852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f86b3a6dd9470f80a2053416a16ebb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.936953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 850/1678] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:11.938090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:11.946057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:11.962459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f86b3a6dd9470f80a2053416a16ebb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:11.994757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 829/1679] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:11 2022] DELETE /identity/v3/users/89f86b3a6dd9470f80a2053416a16ebb => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:11.999779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:12.002964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:12.114159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00758c-6fb6-40a0-b235-2e7a1ecc508f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:12.194243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0811c-7186-46dc-a17c-2ad413edfa34 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:12.212541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:12.213413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:12.213714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:12.214000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:12.214720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:12.216717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:12.282146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:12.282828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:12.283124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:12.283608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:12.290305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:12.297184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 830/1680] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:11 2022] POST /identity/v3/projects => generated 373 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:12.298102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:12.366083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:12.448651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:12.450935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:12.467252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 851/1681] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:12.467793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dd1ab-2296-4db4-abc5-f2eb13d1e998 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:12.468399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:12.469935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:12.484933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:12.485887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:12.486179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:12.486467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:12.487207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:12.488078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe9053-0df2-4cff-b50f-31a941cfa137 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:12.497971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:12.505772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:12.509285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:12.509578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:12.509866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] PATH_INFO: `/v3/users/0d676c1575cb4e319f11a365c14e0de3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:12.512230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d676c1575cb4e319f11a365c14e0de3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:12.514966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:12.524654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:12.568044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 831/1682] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:12 2022] POST /identity/v3/users => generated 287 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:12.569228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:12.574158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:12.606728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1026d1-d286-4fd0-89eb-0b43dbdef52e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:12.625978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:12.626900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:12.627176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:12.627457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] PATH_INFO: `/v3/users/a4d8bdfd1882490db52e290e5237d71b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:12.631782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d8bdfd1882490db52e290e5237d71b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:12.637864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:12.644542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d676c1575cb4e319f11a365c14e0de3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.646844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d676c1575cb4e319f11a365c14e0de3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.648557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d676c1575cb4e319f11a365c14e0de3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.674978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d676c1575cb4e319f11a365c14e0de3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.703955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d676c1575cb4e319f11a365c14e0de3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.742150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 852/1683] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:12 2022] DELETE /identity/v3/users/0d676c1575cb4e319f11a365c14e0de3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:12.745176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:12.747665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:12.779563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d8bdfd1882490db52e290e5237d71b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.782120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d8bdfd1882490db52e290e5237d71b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.784320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d8bdfd1882490db52e290e5237d71b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.832223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d8bdfd1882490db52e290e5237d71b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.863233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d8bdfd1882490db52e290e5237d71b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:12.899776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 832/1684] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:12 2022] DELETE /identity/v3/users/a4d8bdfd1882490db52e290e5237d71b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:12.904861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:12.906983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:12.923479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9520fbe-963f-4486-91d5-06123015c34e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:13.101476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:13.103819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:13.104106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:13.104459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] PATH_INFO: `/v3/projects/d5223955c846440693dd84ca102dea73` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:13.107100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5223955c846440693dd84ca102dea73)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:13.109338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:13.117732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c140cea1-7385-421d-bdbb-e6ebc852699b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:13.129586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4bc6e-1330-4434-a430-271a1468e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:13.130279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4bc6e-1330-4434-a430-271a1468e95e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:13.130569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4bc6e-1330-4434-a430-271a1468e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:13.130845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4bc6e-1330-4434-a430-271a1468e95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:13.131746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4bc6e-1330-4434-a430-271a1468e95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:13.138925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4bc6e-1330-4434-a430-271a1468e95e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:13.184333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 833/1685] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:13.201415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:13.202011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:13.202011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:13.277990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:13.293745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:13.295024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:13.322760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5223955c846440693dd84ca102dea73', 'request_id': 'req-034a011b-8e7c-409c-9291-65ef9b46fcbe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:13.338227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5223955c846440693dd84ca102dea73', 'request_id': 'req-034a011b-8e7c-409c-9291-65ef9b46fcbe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:13.356225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:13.358132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5223955c846440693dd84ca102dea73', 'request_id': 'req-034a011b-8e7c-409c-9291-65ef9b46fcbe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:13.386575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] The token cache is being invalidate because project d5223955c846440693dd84ca102dea73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:13.391118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:13.392089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-034a011b-8e7c-409c-9291-65ef9b46fcbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:13.395815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 853/1686] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:12 2022] DELETE /identity/v3/projects/d5223955c846440693dd84ca102dea73 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:13.405669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:13.405970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:13.406254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:13.463059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:13.464842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:13.506205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 834/1687] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:13.513258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:13.516082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:13.585097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e27710-5125-4789-a1c5-fc557fc21888 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:13.608873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9de2bd-f7ef-46d0-921b-d4ee5a6e8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:13.609878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de2bd-f7ef-46d0-921b-d4ee5a6e8365 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:13.610169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de2bd-f7ef-46d0-921b-d4ee5a6e8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:13.610446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9de2bd-f7ef-46d0-921b-d4ee5a6e8365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:13.611279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9de2bd-f7ef-46d0-921b-d4ee5a6e8365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:13.635878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9de2bd-f7ef-46d0-921b-d4ee5a6e8365 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:13.700503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 835/1688] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:13.702080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f0f22-4e77-44ac-b6f6-bff511bde0cc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:13.702369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f0f22-4e77-44ac-b6f6-bff511bde0cc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:13.702664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f0f22-4e77-44ac-b6f6-bff511bde0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:13.761384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 854/1689] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:13.765396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:13.767635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:13.779505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d85f0f22-4e77-44ac-b6f6-bff511bde0cc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:13.780854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d85f0f22-4e77-44ac-b6f6-bff511bde0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:13.807731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 836/1690] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:13.808987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f0f22-4e77-44ac-b6f6-bff511bde0cc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:13.848384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f0f22-4e77-44ac-b6f6-bff511bde0cc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:13.860559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:13.861477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:13.861752 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:13.862026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] PATH_INFO: `/v3/projects/0cc2546d042a4767bf59f5e5552a6cea/users/2c592a857f60454984c3ceefbe6f41f4/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:13.912878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc2546d042a4767bf59f5e5552a6cea, user_id=2c592a857f60454984c3ceefbe6f41f4, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:13.923497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:13.969110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7c7eb-17dc-45bc-b496-dbbb05adb69d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:13.971753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 837/1691] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:13 2022] PUT /identity/v3/projects/0cc2546d042a4767bf59f5e5552a6cea/users/2c592a857f60454984c3ceefbe6f41f4/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:13.983569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:13.986038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:14.101518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16489b-62ce-4315-9636-6f0a3636ef33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:14.102213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16489b-62ce-4315-9636-6f0a3636ef33 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.102502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16489b-62ce-4315-9636-6f0a3636ef33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.102783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16489b-62ce-4315-9636-6f0a3636ef33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.113939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c5f62-ed29-4a96-b7c3-273ec45125c5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:14.125495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9944c6-64af-4af1-9d3b-2deb35617ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:14.126718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9944c6-64af-4af1-9d3b-2deb35617ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.127800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9944c6-64af-4af1-9d3b-2deb35617ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.128088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9944c6-64af-4af1-9d3b-2deb35617ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.219851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:14.307089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9944c6-64af-4af1-9d3b-2deb35617ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:14.309195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16489b-62ce-4315-9636-6f0a3636ef33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:14.312277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9944c6-64af-4af1-9d3b-2deb35617ac2 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:14.318425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16489b-62ce-4315-9636-6f0a3636ef33 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:14.337010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 838/1692] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:14.340591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033a09-0894-4869-864b-f74ea305433a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.341066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033a09-0894-4869-864b-f74ea305433a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.341502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58033a09-0894-4869-864b-f74ea305433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.345913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 855/1693] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:14.352790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9200-124d-4e91-baae-86001270920d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.354071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9200-124d-4e91-baae-86001270920d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.354367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa9200-124d-4e91-baae-86001270920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.384718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-58033a09-0894-4869-864b-f74ea305433a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:14.386143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-58033a09-0894-4869-864b-f74ea305433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:14.412203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 839/1694] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:14.414646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302c723-e9fb-4503-9738-d4dbda1af628 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.414960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302c723-e9fb-4503-9738-d4dbda1af628 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.415237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302c723-e9fb-4503-9738-d4dbda1af628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.431073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-16aa9200-124d-4e91-baae-86001270920d None None] MFA Rules not processed for user `26922cee7b794e0ca8cec43b6f5daff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:14.436685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-16aa9200-124d-4e91-baae-86001270920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:14.493199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a302c723-e9fb-4503-9738-d4dbda1af628 None None] MFA Rules not processed for user `2c592a857f60454984c3ceefbe6f41f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:14.495700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a302c723-e9fb-4503-9738-d4dbda1af628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:14.530779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:14.564158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 856/1695] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:14.565942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa9200-124d-4e91-baae-86001270920d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:14.583706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa9200-124d-4e91-baae-86001270920d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:14.591767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59415f2-7019-4b8c-90f0-4a6537d124e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:14.592904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59415f2-7019-4b8c-90f0-4a6537d124e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.593271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59415f2-7019-4b8c-90f0-4a6537d124e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.593955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59415f2-7019-4b8c-90f0-4a6537d124e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.595297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59415f2-7019-4b8c-90f0-4a6537d124e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:14.595701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59415f2-7019-4b8c-90f0-4a6537d124e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:14.597897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59415f2-7019-4b8c-90f0-4a6537d124e0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:14.630041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 857/1696] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:14.632581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e418-9d91-4859-9e5f-f2200f1640b9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.632581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e418-9d91-4859-9e5f-f2200f1640b9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.632842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64e418-9d91-4859-9e5f-f2200f1640b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.651082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 840/1697] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:14.651082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302c723-e9fb-4503-9738-d4dbda1af628 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:14.656442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5f64e418-9d91-4859-9e5f-f2200f1640b9 None None] MFA Rules not processed for user `26922cee7b794e0ca8cec43b6f5daff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:14.658262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5f64e418-9d91-4859-9e5f-f2200f1640b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:14.665461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302c723-e9fb-4503-9738-d4dbda1af628 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:14.670552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 858/1698] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:14.671172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:14.671949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e418-9d91-4859-9e5f-f2200f1640b9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:14.672125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.672500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.672993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.673748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:14.676072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:14.689319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64e418-9d91-4859-9e5f-f2200f1640b9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:14.695548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:14.695857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.696260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.696767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.697674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:14.700233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:14.726691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 841/1699] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:14.729378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:14.731750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:14.755572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 859/1700] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:14.757666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:14.895234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9492-5fcf-4958-890a-988b59165e56 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:14.924322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba13fc4-41ec-414c-ae75-ed0e9deae7b5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:14.934647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:14.935360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:14.937338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:14.938016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:14.938414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:14.943274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:14.970430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 860/1701] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:14.974873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:14.983455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:14.993819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7a465b-6e0b-4cad-a409-cdd432ae6a3c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:14.998159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.003407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.004038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.004361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.004996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.005838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.008167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.008989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.009601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.010150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.036441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 861/1702] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:14 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:15.037494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.047073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:15.058878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b022907-6b2b-4d46-8b2b-27903f2a9e40 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.064528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.066107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.066549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.067155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.068045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.071464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.107416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 862/1703] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:15.107416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.107760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.108249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.126974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ee7e5-ce75-4c50-afda-43f8e49e0071 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.129938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 842/1704] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:15.145989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.157295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.157994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.158277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.160477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.161316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.168054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.174199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08615c-fcb3-4d89-b232-84ddaf0c75b4 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.188971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.189705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.190066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.190523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.192827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.194692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 863/1705] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:15.195674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.201968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.213196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:15.224724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 843/1706] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:15.225709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.245954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b381ab5-40a9-449d-9b8c-6ecb4c49bac6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.247101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db072f-2dce-40dd-a976-fe343815ab30 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.256678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.257970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.258487 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.258965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] PATH_INFO: `/v3/projects/620e608ba09f414aa43b6adcd06b3fa6/users/4b7c2617402b440da91ccbae1345b50e/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.261538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.262496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.263329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.264279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] PATH_INFO: `/v3/projects/a312ecab6f8241c1b7622221e2b0d917` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.267256 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a312ecab6f8241c1b7622221e2b0d917)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.275302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.289091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=620e608ba09f414aa43b6adcd06b3fa6, user_id=4b7c2617402b440da91ccbae1345b50e, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.292257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.319339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 844/1707] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:15 2022] PUT /identity/v3/projects/620e608ba09f414aa43b6adcd06b3fa6/users/4b7c2617402b440da91ccbae1345b50e/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:15.321925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.381210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a312ecab6f8241c1b7622221e2b0d917', 'request_id': 'req-9f20a08f-2615-4483-9c83-5cd560adcd41'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.397210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a312ecab6f8241c1b7622221e2b0d917', 'request_id': 'req-9f20a08f-2615-4483-9c83-5cd560adcd41'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.417234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a312ecab6f8241c1b7622221e2b0d917', 'request_id': 'req-9f20a08f-2615-4483-9c83-5cd560adcd41'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.437123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] The token cache is being invalidate because project a312ecab6f8241c1b7622221e2b0d917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:15.437572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.438377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.444378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 864/1708] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:15 2022] DELETE /identity/v3/projects/a312ecab6f8241c1b7622221e2b0d917 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:15.445590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.450367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:15.479602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedb5ca-9aec-41ea-8979-53a876c34ae5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.609985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20a08f-2615-4483-9c83-5cd560adcd41 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.624243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.625153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.625553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.625942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.626826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.627464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.628564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.628932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.629126 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.629552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] PATH_INFO: `/v3/projects/296045c2a5f841d084bd9d3ff5d7763b/users/f35147f834f545619889c6f6ef65f809/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.656594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 865/1709] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:15.660728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.671093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:15.694377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=296045c2a5f841d084bd9d3ff5d7763b, user_id=f35147f834f545619889c6f6ef65f809, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.696376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7901a8c-b696-4817-bd00-76d79495089f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.696876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.711045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:15.712213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.713489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.713489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] PATH_INFO: `/v3/users/e8dab8d3442b42b0a4ce132306bc8f9f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.714885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8dab8d3442b42b0a4ce132306bc8f9f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:15.718115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:15.750850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 845/1710] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:15 2022] PUT /identity/v3/projects/296045c2a5f841d084bd9d3ff5d7763b/users/f35147f834f545619889c6f6ef65f809/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:15.751972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:15.809887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:15.822148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:15.822994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8dab8d3442b42b0a4ce132306bc8f9f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.823895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8dab8d3442b42b0a4ce132306bc8f9f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.825768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8dab8d3442b42b0a4ce132306bc8f9f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.856244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8dab8d3442b42b0a4ce132306bc8f9f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.869264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55761320-75cc-427e-957d-153595fdf461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8dab8d3442b42b0a4ce132306bc8f9f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:15.894422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 866/1711] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:15 2022] DELETE /identity/v3/users/e8dab8d3442b42b0a4ce132306bc8f9f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:15.895772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:15.896076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:15.896592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:15.905573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ee084-8399-4072-8746-179a447c9203 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:15.961847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] MFA Rules not processed for user `f35147f834f545619889c6f6ef65f809`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:15.963373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:16.042650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41512ecf-173b-4a22-b9e0-4f3fe6295fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:16.043563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512ecf-173b-4a22-b9e0-4f3fe6295fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:16.043843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512ecf-173b-4a22-b9e0-4f3fe6295fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:16.044115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512ecf-173b-4a22-b9e0-4f3fe6295fed admin admin] PATH_INFO: `/v3/projects/620e608ba09f414aa43b6adcd06b3fa6/users/4b7c2617402b440da91ccbae1345b50e/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:16.050564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41512ecf-173b-4a22-b9e0-4f3fe6295fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=620e608ba09f414aa43b6adcd06b3fa6, user_id=4b7c2617402b440da91ccbae1345b50e, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:16.053287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41512ecf-173b-4a22-b9e0-4f3fe6295fed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:16.082963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 846/1712] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:15 2022] PUT /identity/v3/projects/620e608ba09f414aa43b6adcd06b3fa6/users/4b7c2617402b440da91ccbae1345b50e/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:16.094185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf9696-cac2-4430-ba4f-e416d41e5e4c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:16.094474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf9696-cac2-4430-ba4f-e416d41e5e4c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:16.094746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf9696-cac2-4430-ba4f-e416d41e5e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:16.135675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 867/1713] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:16.139509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:16.141686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:16.153187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-24bf9696-cac2-4430-ba4f-e416d41e5e4c None None] MFA Rules not processed for user `4b7c2617402b440da91ccbae1345b50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:16.156128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-24bf9696-cac2-4430-ba4f-e416d41e5e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:16.175010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c2e41-ad1c-4818-b989-e049d75c7d62 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:16.350834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 847/1714] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:16.353393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42600-ddfa-4327-86b3-a3e3750aa1f6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:16.354172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42600-ddfa-4327-86b3-a3e3750aa1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:16.354809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b42600-ddfa-4327-86b3-a3e3750aa1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:16.407171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-18b42600-ddfa-4327-86b3-a3e3750aa1f6 None None] MFA Rules not processed for user `9c13ce02fca548c5b1186a536a2d4474`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:16.408787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-18b42600-ddfa-4327-86b3-a3e3750aa1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:16.432957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:16.434052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:16.434840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:16.435504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:16.436604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:16.451168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:16.497864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:16.559898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 868/1715] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:16 2022] POST /identity/v3/projects => generated 371 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:16.564578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:16.568009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:16.621106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 848/1716] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:16.623200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b42600-ddfa-4327-86b3-a3e3750aa1f6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:16.651544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b42600-ddfa-4327-86b3-a3e3750aa1f6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:16.671930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:16.726455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0f6af-e5dc-4b87-8460-05dedccb752d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:16.743469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:16.744672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:16.746716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:16.747197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:16.887455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:16.889796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:16.897352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:16.897534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:16.898574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:16.902868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:16.956224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 849/1717] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:16 2022] POST /identity/v3/users => generated 292 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:16.956224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:16.964964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:16.972602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:16.978864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:17.021461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 869/1718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:17.023217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:17.088840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc48672-5b09-4570-831c-2d1e964c1e85 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:17.106754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:17.107457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.107743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.108019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.113985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:17.119066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:17.137856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb26928-a44a-4667-8527-85c236385584 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:17.147253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 870/1719] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:17.151360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:17.152681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7e0da6-c809-4528-80d4-d83ff4f4cef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:17.153364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e0da6-c809-4528-80d4-d83ff4f4cef7 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.153696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e0da6-c809-4528-80d4-d83ff4f4cef7 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.153979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e0da6-c809-4528-80d4-d83ff4f4cef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.178862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc0e95-6dc8-46f1-be93-ada81436f398 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:17.194760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:17.197202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.199149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.199541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] PATH_INFO: `/v3/projects/58076bf974f24b3ab6ec6754c85b6f53/users/e4112c1256c24c879902c47eaf21ecb0/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.231548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58076bf974f24b3ab6ec6754c85b6f53, user_id=e4112c1256c24c879902c47eaf21ecb0, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:17.235126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:17.254547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 871/1720] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:17 2022] PUT /identity/v3/projects/58076bf974f24b3ab6ec6754c85b6f53/users/e4112c1256c24c879902c47eaf21ecb0/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:17.259911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:17.310484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e0da6-c809-4528-80d4-d83ff4f4cef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:17.313191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7e0da6-c809-4528-80d4-d83ff4f4cef7 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:17.339419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 850/1721] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:17.341543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284796fe-62b9-419c-bc07-8d24f376c20d None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.341543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284796fe-62b9-419c-bc07-8d24f376c20d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.342312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284796fe-62b9-419c-bc07-8d24f376c20d None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.351633 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 851/1722] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 16 21:13:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:13:17.356967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.357558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.357933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.374405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:17.383112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0dd72-ac9b-4840-a564-02d035c88575 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:17.416374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:17.418051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.418258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.418546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.424859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:17.426521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:17.461159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] MFA Rules not processed for user `d9ea56567eeb4392b5f9e5c84f16f413`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:17.466784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:17.478863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 872/1723] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:17.482516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:17.521016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c585610-9e2f-4757-a0f5-0d1417959009 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:17.534098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4094-13bf-4cf9-8dcf-33ae5589e323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:17.535178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4094-13bf-4cf9-8dcf-33ae5589e323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.535572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4094-13bf-4cf9-8dcf-33ae5589e323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.535858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4094-13bf-4cf9-8dcf-33ae5589e323 admin admin] PATH_INFO: `/v3/projects/58076bf974f24b3ab6ec6754c85b6f53/users/e4112c1256c24c879902c47eaf21ecb0/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.542635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4094-13bf-4cf9-8dcf-33ae5589e323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58076bf974f24b3ab6ec6754c85b6f53, user_id=e4112c1256c24c879902c47eaf21ecb0, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:17.549415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4094-13bf-4cf9-8dcf-33ae5589e323 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:17.584007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 873/1724] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:17 2022] PUT /identity/v3/projects/58076bf974f24b3ab6ec6754c85b6f53/users/e4112c1256c24c879902c47eaf21ecb0/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:17.595997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed064580-9e9a-4625-a731-178ef4119803 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.596445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed064580-9e9a-4625-a731-178ef4119803 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.600841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed064580-9e9a-4625-a731-178ef4119803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.665636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 852/1725] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:17.666469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ed064580-9e9a-4625-a731-178ef4119803 None None] MFA Rules not processed for user `e4112c1256c24c879902c47eaf21ecb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:17.668328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ed064580-9e9a-4625-a731-178ef4119803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:17.706837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:17.756553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:17.759646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:17.792206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57921632-127c-4b58-b1cb-b86ffa0b622a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:17.911945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 874/1726] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:17.914913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.915458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.923778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.949368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:17.950340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:17.950697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:17.951052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] PATH_INFO: `/v3/projects/7c1060efcf034d2d99368666fa90cce4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:17.952625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1060efcf034d2d99368666fa90cce4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:17.954962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:17.955704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] MFA Rules not processed for user `8cc395fc4407473e9595bc99c6b6b36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:17.957996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:18.087191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1060efcf034d2d99368666fa90cce4', 'request_id': 'req-d91a0f38-2146-42fe-857c-9053a2fb73be'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.100674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1060efcf034d2d99368666fa90cce4', 'request_id': 'req-d91a0f38-2146-42fe-857c-9053a2fb73be'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.125567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1060efcf034d2d99368666fa90cce4', 'request_id': 'req-d91a0f38-2146-42fe-857c-9053a2fb73be'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.132626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 875/1727] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:18.136840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:18.138546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:18.143536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] The token cache is being invalidate because project 7c1060efcf034d2d99368666fa90cce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:18.144003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.144814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.147531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 853/1728] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:17 2022] DELETE /identity/v3/projects/7c1060efcf034d2d99368666fa90cce4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:18.148464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:18.150118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:18.278047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:18.327781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a0f38-2146-42fe-857c-9053a2fb73be admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:18.330467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:18.331334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:18.331620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:18.331894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:18.334279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:18.389454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58432a-f5b9-4408-abb8-0eba9f932271 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:18.497989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:18.499434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:18.521687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 854/1729] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:18.522604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:18.532611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:18.576606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:18.577419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:18.577727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:18.578678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:18.591501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:18.612849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:18.615475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:18.630192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 876/1730] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:18.631554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:18.637779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:18.704765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:18.722847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a15095-5478-45a8-a1ca-74342f3b74f3 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:18.734368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:18.735725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:18.736020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:18.736320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] PATH_INFO: `/v3/projects/dae1eddc6c814d689d18b54b13bd8970` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:18.742893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae1eddc6c814d689d18b54b13bd8970)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:18.745836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:18.817899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22853af6-29eb-487f-ba56-6616ecd3818f service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:18.837415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:18.838323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:18.839150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:18.839150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] PATH_INFO: `/v3/users/2c592a857f60454984c3ceefbe6f41f4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:18.842152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c592a857f60454984c3ceefbe6f41f4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:18.845396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:18.857294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae1eddc6c814d689d18b54b13bd8970', 'request_id': 'req-9b10965a-e065-49f5-b44f-377d4e2df969'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.872562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae1eddc6c814d689d18b54b13bd8970', 'request_id': 'req-9b10965a-e065-49f5-b44f-377d4e2df969'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.893346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae1eddc6c814d689d18b54b13bd8970', 'request_id': 'req-9b10965a-e065-49f5-b44f-377d4e2df969'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.918793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] The token cache is being invalidate because project dae1eddc6c814d689d18b54b13bd8970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:18.921686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.926257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9b10965a-e065-49f5-b44f-377d4e2df969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.932135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 855/1731] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:18 2022] DELETE /identity/v3/projects/dae1eddc6c814d689d18b54b13bd8970 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:18.942109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc5a5-a772-4a68-aff8-ab436a830426 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:18.943647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc5a5-a772-4a68-aff8-ab436a830426 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:18.946196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fc5a5-a772-4a68-aff8-ab436a830426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:18.986157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c592a857f60454984c3ceefbe6f41f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.987622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c592a857f60454984c3ceefbe6f41f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:18.988493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c592a857f60454984c3ceefbe6f41f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:19.005621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-973fc5a5-a772-4a68-aff8-ab436a830426 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:19.008325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-973fc5a5-a772-4a68-aff8-ab436a830426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.024626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:19.028446 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c592a857f60454984c3ceefbe6f41f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:19.055526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c592a857f60454984c3ceefbe6f41f4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:19.088626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 877/1732] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:18 2022] DELETE /identity/v3/users/2c592a857f60454984c3ceefbe6f41f4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:19.089724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:19.093526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.188843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 856/1733] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:19.188843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71619c-b664-41c7-a601-dfb99975e6c1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.188843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71619c-b664-41c7-a601-dfb99975e6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.188843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71619c-b664-41c7-a601-dfb99975e6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.216167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ec71619c-b664-41c7-a601-dfb99975e6c1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:19.217415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ec71619c-b664-41c7-a601-dfb99975e6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.241620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004300-d4bf-4c82-9d31-4eb61f610054 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:19.245913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248180f9-5a70-4298-b507-68c5cdda1d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:19.246659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248180f9-5a70-4298-b507-68c5cdda1d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.247023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248180f9-5a70-4298-b507-68c5cdda1d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.247373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248180f9-5a70-4298-b507-68c5cdda1d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.250039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-248180f9-5a70-4298-b507-68c5cdda1d5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.328578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 857/1734] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:19.330033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1b3d-93fa-4872-901d-de4452ef4fbe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.330399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1b3d-93fa-4872-901d-de4452ef4fbe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.330757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a1b3d-93fa-4872-901d-de4452ef4fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.350622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:19.370341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-848a1b3d-93fa-4872-901d-de4452ef4fbe None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:19.371739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248180f9-5a70-4298-b507-68c5cdda1d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:19.373827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248180f9-5a70-4298-b507-68c5cdda1d5d service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:19.375346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-848a1b3d-93fa-4872-901d-de4452ef4fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.397268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 858/1735] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:19.399740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279979-2236-4c98-89ba-024f273b4902 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.400194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279979-2236-4c98-89ba-024f273b4902 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.400576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb279979-2236-4c98-89ba-024f273b4902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.407150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 878/1736] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:19.420684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b501ff-087c-40d0-a7f1-0df23f6d0832 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.422329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b501ff-087c-40d0-a7f1-0df23f6d0832 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.422759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b501ff-087c-40d0-a7f1-0df23f6d0832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.433031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fb279979-2236-4c98-89ba-024f273b4902 None None] MFA Rules not processed for user `2cb12a51b62c48ba95be62f167b7314e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:19.434607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fb279979-2236-4c98-89ba-024f273b4902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.470832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-43b501ff-087c-40d0-a7f1-0df23f6d0832 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:19.473372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-43b501ff-087c-40d0-a7f1-0df23f6d0832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.500501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 879/1737] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:19.504126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.505757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.505757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.548531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:19.550111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.576647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 880/1738] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:19.578213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:19.583961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 859/1739] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:19.584870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279979-2236-4c98-89ba-024f273b4902 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:19.615044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.615502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb279979-2236-4c98-89ba-024f273b4902 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:19.629729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:19.630418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.630698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.630971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.631704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:19.632550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:19.634386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:19.671189 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 860/1740] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:19.674971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:19.714030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb9494-44b9-4190-af02-169a4914d585 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:19.738736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce781ec5-25d5-4a97-892e-67c59371bc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:19.739627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781ec5-25d5-4a97-892e-67c59371bc8a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.740061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781ec5-25d5-4a97-892e-67c59371bc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.746096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce781ec5-25d5-4a97-892e-67c59371bc8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.747734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce781ec5-25d5-4a97-892e-67c59371bc8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:19.748224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce781ec5-25d5-4a97-892e-67c59371bc8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:19.750022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce781ec5-25d5-4a97-892e-67c59371bc8a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:19.770771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee143de-a45b-45e8-bae5-e846ab73c056 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:19.776002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:19.778186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.778546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.778905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.791361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 861/1741] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:19.793181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f0b9-bf14-4c68-8dad-f34d004f32ac None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.793628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f0b9-bf14-4c68-8dad-f34d004f32ac None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.794052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5f0b9-bf14-4c68-8dad-f34d004f32ac None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.795577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 862/1742] 10.222.0.43 () {54 vars in 912 bytes} [Thu Jun 16 21:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:13:19.797042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f0b9-bf14-4c68-8dad-f34d004f32ac None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:19.802290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:19.810981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:19.812167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8bd5f0b9-bf14-4c68-8dad-f34d004f32ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:19.831465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 881/1743] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:19.832853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:19.847207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eefb98-2573-46a8-ada6-d220e13b87e8 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:19.854551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:19.855721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:19.856107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:19.856574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:19.857860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:19.860565 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:19.881821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:19.915504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 882/1744] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:19 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:19.915504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:19.951203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5f0b9-bf14-4c68-8dad-f34d004f32ac None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.054349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb43e1-8cae-4f5d-b55b-046236f1d711 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.060244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3151cd-4ca7-4b0a-94f4-f21d9f6685f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.061220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3151cd-4ca7-4b0a-94f4-f21d9f6685f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.061697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3151cd-4ca7-4b0a-94f4-f21d9f6685f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.062784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3151cd-4ca7-4b0a-94f4-f21d9f6685f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.063673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3151cd-4ca7-4b0a-94f4-f21d9f6685f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.066022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3151cd-4ca7-4b0a-94f4-f21d9f6685f7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.116133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 883/1745] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:19 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:20.117661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c90cd8-6d4a-4f0d-afe6-7a442f0b6f5e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.119627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c90cd8-6d4a-4f0d-afe6-7a442f0b6f5e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.120425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c90cd8-6d4a-4f0d-afe6-7a442f0b6f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.137831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.139894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.140345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.140647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.149736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:20.190759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.194305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.198782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f4c90cd8-6d4a-4f0d-afe6-7a442f0b6f5e None None] MFA Rules not processed for user `d9ea56567eeb4392b5f9e5c84f16f413`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:20.200329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f4c90cd8-6d4a-4f0d-afe6-7a442f0b6f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:20.237781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 863/1746] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:20.239089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.267006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292b89ec-a24c-420b-8d4a-76dda49db046 service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.307323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:20.334675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 884/1747] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:13:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:20.336438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c90cd8-6d4a-4f0d-afe6-7a442f0b6f5e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.410071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.415602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.415808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.416082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.416837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.425372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.481726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 864/1748] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:20 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:20.483069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.514639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6291f4-2147-4977-a63a-c41aa686d9dd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.515829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c90cd8-6d4a-4f0d-afe6-7a442f0b6f5e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.522629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.523775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.524153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.524584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.525486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.526639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.527329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.527608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.527881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.528243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.528641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.530335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.560316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 885/1749] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:20 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:20.564277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.570864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 865/1750] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:20.571872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.578725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719f6b0-3295-4da3-bd7e-bcdd4f459b4a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.584860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.586215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.586600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.587168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.587911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.591312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.604919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 886/1751] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:20.606386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.612253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:20.620427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60645559-f1da-43d7-8b77-4cc54c893ec3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.633232 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.633926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.634207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.634484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.634860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9e887-7587-45ba-a92d-6e8bd3fe4376 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.635218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.645387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.648726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.650051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.650997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.651606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] PATH_INFO: `/v3/projects/0cc2546d042a4767bf59f5e5552a6cea` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.654094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc2546d042a4767bf59f5e5552a6cea)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.671896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.688142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 866/1752] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:20.690918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.717495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9a51e-4d66-47c4-bdfe-366b4dba020b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.747043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:20.748032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:20.748977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:20.749435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:20.750412 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:20.757169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:20.800771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 867/1753] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:20.801758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:20.809305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:20.860153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57cbf0-fe99-4bbe-9af9-7f15e42eb2a5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:20.864247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc2546d042a4767bf59f5e5552a6cea', 'request_id': 'req-1e8cd074-b650-4c68-90e2-7d712f253916'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:20.902074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:20.904884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc2546d042a4767bf59f5e5552a6cea', 'request_id': 'req-1e8cd074-b650-4c68-90e2-7d712f253916'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:20.936647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc2546d042a4767bf59f5e5552a6cea', 'request_id': 'req-1e8cd074-b650-4c68-90e2-7d712f253916'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:20.987391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] The token cache is being invalidate because project 0cc2546d042a4767bf59f5e5552a6cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:20.988581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:20.992327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:21.011363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 887/1754] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:20 2022] DELETE /identity/v3/projects/0cc2546d042a4767bf59f5e5552a6cea => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:21.012309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:21.019900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:21.029938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:21.030619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:21.030912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:21.031190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:21.052929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:21.095497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:21.100346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:21.143963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 868/1755] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:21.144992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:21.152263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:21.269130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:21.287693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8cd074-b650-4c68-90e2-7d712f253916 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:21.307440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:21.308391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:21.308676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:21.309461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] PATH_INFO: `/v3/projects/d8ebfca33fbd4f53956ec00c5371673a/users/9425f2cb90b545c4ae9fc448c0785373/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:21.343327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ebfca33fbd4f53956ec00c5371673a, user_id=9425f2cb90b545c4ae9fc448c0785373, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:21.347233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:21.377604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e9ff-63f9-4bcb-8f95-310e61b8f127 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:21.383503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 888/1756] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:21 2022] PUT /identity/v3/projects/d8ebfca33fbd4f53956ec00c5371673a/users/9425f2cb90b545c4ae9fc448c0785373/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:21.390605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:21.395502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:21.527467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cdc78-8738-43ea-83ba-0ae3a403c37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:21.529535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cdc78-8738-43ea-83ba-0ae3a403c37f admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:21.530169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cdc78-8738-43ea-83ba-0ae3a403c37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:21.530682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cdc78-8738-43ea-83ba-0ae3a403c37f admin admin] PATH_INFO: `/v3/projects/5791300c4cf94ca58030667bacff79cb/users/ff51d1994c0f4ce9b49e0a2fa09e7722/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:21.558402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cdc78-8738-43ea-83ba-0ae3a403c37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5791300c4cf94ca58030667bacff79cb, user_id=ff51d1994c0f4ce9b49e0a2fa09e7722, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:21.562264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cdc78-8738-43ea-83ba-0ae3a403c37f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:21.611940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b31e5e-1542-4a13-9454-fc6b85a16877 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:21.625932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 869/1757] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:21 2022] PUT /identity/v3/projects/5791300c4cf94ca58030667bacff79cb/users/ff51d1994c0f4ce9b49e0a2fa09e7722/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:21.629894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a40b-25b0-4c31-80f4-69d05d145a22 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:21.632937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a40b-25b0-4c31-80f4-69d05d145a22 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:21.633393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772a40b-25b0-4c31-80f4-69d05d145a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:21.715392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f772a40b-25b0-4c31-80f4-69d05d145a22 None None] MFA Rules not processed for user `9425f2cb90b545c4ae9fc448c0785373`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:21.716672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f772a40b-25b0-4c31-80f4-69d05d145a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:21.810818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:21.811730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:21.812015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:21.812321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] PATH_INFO: `/v3/users/4b7c2617402b440da91ccbae1345b50e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:21.814751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7c2617402b440da91ccbae1345b50e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:21.816753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:21.848008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:21.955820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 870/1758] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:21.956971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:21.961562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:21.961915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:21.965234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7c2617402b440da91ccbae1345b50e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:21.970498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7c2617402b440da91ccbae1345b50e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:21.971367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7c2617402b440da91ccbae1345b50e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:22.016129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7c2617402b440da91ccbae1345b50e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:22.033779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7c2617402b440da91ccbae1345b50e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:22.068935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] MFA Rules not processed for user `ff51d1994c0f4ce9b49e0a2fa09e7722`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:22.070490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 889/1759] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:21 2022] DELETE /identity/v3/users/4b7c2617402b440da91ccbae1345b50e => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:22.071523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:22.071917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:22.075109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:22.089980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:22.319751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 871/1760] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:22.321093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:22.322594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:22.351610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ea547-bf41-4e01-a105-3d1be233461a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:22.355702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfbd9f-9b19-446c-b333-47a9dfd05525 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:22.369058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:22.369967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.370710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.370710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.371597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:22.378500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:22.382155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:22.382858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.383147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.383428 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.384137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:22.393728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:22.439298 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 872/1761] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:22 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:13:22.451898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:22.485634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 890/1762] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:22 2022] POST /identity/v3/projects => generated 367 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:22.489684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:22.684920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c964845-e8cf-47d5-8f49-fb5f219467ea admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:22.699237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:22.701670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.701670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.701670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.701670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:22.703149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:22.711972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65447-7ab1-47c0-8b8a-f079dc827107 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:22.725608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:22.729205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.729655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.730634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.733159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:22.738777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:22.768492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 891/1763] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:22 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:22.771960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:22.805176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7aad0-22d3-4a72-a194-dcb334f10352 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:22.805792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 873/1764] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:22 2022] POST /identity/v3/users => generated 300 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:22.807708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:22.818051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:22.818744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.819031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.819312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.822174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:22.825316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:22.833048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0987a62-6177-4cfd-8f2b-6924ce4a8418 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:22.839521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603dce1-5cd8-4d48-b4e7-c86f18c3ec2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:22.840286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603dce1-5cd8-4d48-b4e7-c86f18c3ec2f admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.840574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603dce1-5cd8-4d48-b4e7-c86f18c3ec2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.840998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603dce1-5cd8-4d48-b4e7-c86f18c3ec2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.841790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603dce1-5cd8-4d48-b4e7-c86f18c3ec2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:22.844030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603dce1-5cd8-4d48-b4e7-c86f18c3ec2f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:22.863350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 874/1765] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:22.867365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafeee5-f383-4684-822a-e5fb4dbcb81d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.867615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafeee5-f383-4684-822a-e5fb4dbcb81d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.868107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfafeee5-f383-4684-822a-e5fb4dbcb81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.877477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 892/1766] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:22.879414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:22.912839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cfafeee5-f383-4684-822a-e5fb4dbcb81d None None] MFA Rules not processed for user `9c13ce02fca548c5b1186a536a2d4474`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:22.918415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cfafeee5-f383-4684-822a-e5fb4dbcb81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:22.925947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e4fc4-6afa-4d14-a7e6-0ec739cf9e2d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:22.936522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:22.937479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:22.937764 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:22.938043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] PATH_INFO: `/v3/projects/5bb843231f3d41b9bc2c1f518914cd52/users/fc4d0c3ab4114aa3b78fed5c77c1569b/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:22.998060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:23.022527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb843231f3d41b9bc2c1f518914cd52, user_id=fc4d0c3ab4114aa3b78fed5c77c1569b, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:23.032918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:23.083878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 893/1767] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:22 2022] PUT /identity/v3/projects/5bb843231f3d41b9bc2c1f518914cd52/users/fc4d0c3ab4114aa3b78fed5c77c1569b/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:23.084872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:23.180151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 875/1768] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:23.181025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafeee5-f383-4684-822a-e5fb4dbcb81d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:23.226374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfafeee5-f383-4684-822a-e5fb4dbcb81d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:23.275653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:23.315419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf689-d095-4975-b68c-7bee3ac3d29a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:23.338008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:23.338962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:23.339245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:23.339523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] PATH_INFO: `/v3/projects/c072b0cca0cf4332af01d87bf1148f02/users/eca2531ac4814d739caa06a269ce2864/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:23.407630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c072b0cca0cf4332af01d87bf1148f02, user_id=eca2531ac4814d739caa06a269ce2864, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:23.416362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:23.486614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 894/1769] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:23 2022] PUT /identity/v3/projects/c072b0cca0cf4332af01d87bf1148f02/users/eca2531ac4814d739caa06a269ce2864/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:23.488040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:23.495382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:23.510517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:23.511249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:23.511598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:23.517162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:23.526453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:23.528662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:23.584563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 876/1770] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:23.600467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:23.650733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a28d6a-cab5-44a4-90e2-da5b739f3286 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:23.677951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a3590-a399-424c-aef0-472c9d84a311 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:23.681759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:23.682688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:23.683152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:23.683602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:23.684709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:23.686520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:23.692869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:23.693884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:23.694166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:23.694498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] PATH_INFO: `/v3/projects/620e608ba09f414aa43b6adcd06b3fa6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:23.701323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620e608ba09f414aa43b6adcd06b3fa6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:23.704862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:23.739281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 877/1771] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:23.748276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:23.801483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc30fe-e839-4d79-8b04-faf5adc76797 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:23.812496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620e608ba09f414aa43b6adcd06b3fa6', 'request_id': 'req-dda4ef5c-095e-4847-ac3b-673d20ab7b40'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:23.828631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620e608ba09f414aa43b6adcd06b3fa6', 'request_id': 'req-dda4ef5c-095e-4847-ac3b-673d20ab7b40'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:23.850491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620e608ba09f414aa43b6adcd06b3fa6', 'request_id': 'req-dda4ef5c-095e-4847-ac3b-673d20ab7b40'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:23.904996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] The token cache is being invalidate because project 620e608ba09f414aa43b6adcd06b3fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:23.906671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:23.909025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:23.924004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 895/1772] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:23 2022] DELETE /identity/v3/projects/620e608ba09f414aa43b6adcd06b3fa6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:23.927035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:23.930476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.046364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c689e-c30d-4bcb-b99f-cfb0175309da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:24.047289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c689e-c30d-4bcb-b99f-cfb0175309da admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.047572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c689e-c30d-4bcb-b99f-cfb0175309da admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.052012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c689e-c30d-4bcb-b99f-cfb0175309da admin admin] PATH_INFO: `/v3/projects/5bb843231f3d41b9bc2c1f518914cd52/users/fc4d0c3ab4114aa3b78fed5c77c1569b/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.060303 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c689e-c30d-4bcb-b99f-cfb0175309da admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb843231f3d41b9bc2c1f518914cd52, user_id=fc4d0c3ab4114aa3b78fed5c77c1569b, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:24.064636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c689e-c30d-4bcb-b99f-cfb0175309da admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:24.094921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 878/1773] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:23 2022] PUT /identity/v3/projects/5bb843231f3d41b9bc2c1f518914cd52/users/fc4d0c3ab4114aa3b78fed5c77c1569b/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:24.098309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cdbc1-4111-4761-9a0b-70fbaeddb205 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.098605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cdbc1-4111-4761-9a0b-70fbaeddb205 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.098886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cdbc1-4111-4761-9a0b-70fbaeddb205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.115482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:24.133614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4ef5c-095e-4847-ac3b-673d20ab7b40 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:24.148576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-591cdbc1-4111-4761-9a0b-70fbaeddb205 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:24.149821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-591cdbc1-4111-4761-9a0b-70fbaeddb205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.266784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:24.311858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 879/1774] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:24.320355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9e2db-34e4-434e-a98c-d41d1fbc6094 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.320355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9e2db-34e4-434e-a98c-d41d1fbc6094 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.320355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9e2db-34e4-434e-a98c-d41d1fbc6094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.410983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-40b9e2db-34e4-434e-a98c-d41d1fbc6094 None None] MFA Rules not processed for user `fc4d0c3ab4114aa3b78fed5c77c1569b`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:24.412277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-40b9e2db-34e4-434e-a98c-d41d1fbc6094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.556293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:24.558335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.558868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.559518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] PATH_INFO: `/v3/projects/c072b0cca0cf4332af01d87bf1148f02/users/eca2531ac4814d739caa06a269ce2864/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.562673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c072b0cca0cf4332af01d87bf1148f02, user_id=eca2531ac4814d739caa06a269ce2864, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:24.566900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:24.573087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 880/1775] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:24.575080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5085db9-adbe-427c-8ef3-371dc7add3fc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.575682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5085db9-adbe-427c-8ef3-371dc7add3fc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.576267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5085db9-adbe-427c-8ef3-371dc7add3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.597498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 896/1776] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:23 2022] PUT /identity/v3/projects/c072b0cca0cf4332af01d87bf1148f02/users/eca2531ac4814d739caa06a269ce2864/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:24.598555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:24.602869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.625388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f5085db9-adbe-427c-8ef3-371dc7add3fc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:24.627070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f5085db9-adbe-427c-8ef3-371dc7add3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.723930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f8ba47-436a-400d-8b2e-7acee972f04a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:24.735196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:24.735869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.736257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.736537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.738655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 881/1777] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:24.740119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.740777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.740777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.802318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] MFA Rules not processed for user `eca2531ac4814d739caa06a269ce2864`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:24.803552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.857596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:24.862174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:24.899494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 897/1778] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:24.903481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:24.937470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b5bf-5bca-4114-aeea-2076d439d152 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:24.942948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:24.947375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:24.948679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:24.949173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:24.950085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:24.950531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:24.952738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:24.953399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:24.963291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 882/1779] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:24.964274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:24.971250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.973878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 898/1780] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:24.979108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:24.981752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:24.999884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2767-3000-4c6c-bd41-9fae1939d4b8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.009900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe001d-0a87-41a5-9bcf-720050a6d5bb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.012263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.013069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.013355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.013632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.017744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.018872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.019335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.019781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] PATH_INFO: `/v3/users/ff51d1994c0f4ce9b49e0a2fa09e7722` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.022015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff51d1994c0f4ce9b49e0a2fa09e7722)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.024779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.026381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.028837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.049333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 899/1781] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:25.050327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:25.066603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d3e66-167e-4a7e-b16f-436d617b1b3a service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.077591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.079374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.080930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.081778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.082823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.085054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.145983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff51d1994c0f4ce9b49e0a2fa09e7722'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:25.147193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff51d1994c0f4ce9b49e0a2fa09e7722'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:25.150214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff51d1994c0f4ce9b49e0a2fa09e7722'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:25.159562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:25.173324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 900/1782] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:25 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:25.174471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:25.174578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff51d1994c0f4ce9b49e0a2fa09e7722'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:25.176541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:25.188354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9a12cac-aec9-49c4-b9ca-33ba5a9bf149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff51d1994c0f4ce9b49e0a2fa09e7722'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:25.223108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 883/1783] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:24 2022] DELETE /identity/v3/users/ff51d1994c0f4ce9b49e0a2fa09e7722 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:25.228125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.228481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.228768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.258838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:25.260381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:25.271763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dee9fe-dc73-4308-a62b-04c4eaeb9b29 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.418302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.419234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.420334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.420763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.421574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.425395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.438476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 884/1784] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:25.449696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:25.451683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:25.462539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 901/1785] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:25 2022] POST /identity/v3/users => generated 294 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:25.463721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:25.476723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818f993-7589-4574-b8bd-e338d3e9d775 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.482107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.482980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.483490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.483774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.485113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.486957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.503592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 902/1786] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:25.505243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:25.518250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483977e7-045f-4ba3-b65f-ff13f35bfcde admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.524092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.525279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.525279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.525763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.526518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.529934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.551929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 903/1787] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:25.553116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:25.555656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac694-50c6-4ca9-8135-09c2d86adf57 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.572503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1592ba-20da-4930-88da-8c0d9d34a3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.572842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6d68c-e72d-4672-9225-709096e2c44f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.573266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1592ba-20da-4930-88da-8c0d9d34a3ab service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.573554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1592ba-20da-4930-88da-8c0d9d34a3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.573832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1592ba-20da-4930-88da-8c0d9d34a3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.589348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.590896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.591292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.591752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] PATH_INFO: `/v3/projects/33de0fcc65534358a8a0e18fc24135a8/users/7ae624b33f24403da5c0a6b2b9ea9f08/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.597719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1592ba-20da-4930-88da-8c0d9d34a3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.599352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1592ba-20da-4930-88da-8c0d9d34a3ab service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.624389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 885/1788] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:25.641228 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33de0fcc65534358a8a0e18fc24135a8, user_id=7ae624b33f24403da5c0a6b2b9ea9f08, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:25.650182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:25.699221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 904/1789] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:25 2022] PUT /identity/v3/projects/33de0fcc65534358a8a0e18fc24135a8/users/7ae624b33f24403da5c0a6b2b9ea9f08/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:25.699608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915d6f-42ed-465f-be5e-8c323d5c876b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.699901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915d6f-42ed-465f-be5e-8c323d5c876b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.700202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e915d6f-42ed-465f-be5e-8c323d5c876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:25.744569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:25.750140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7e915d6f-42ed-465f-be5e-8c323d5c876b None None] MFA Rules not processed for user `7ae624b33f24403da5c0a6b2b9ea9f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:25.751427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7e915d6f-42ed-465f-be5e-8c323d5c876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:25.893759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 886/1790] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:25.901089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:25.972647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:25.985954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa81a3-db90-499a-945e-0d960ef09e7e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:25.998567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:25.999325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:25.999518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:25.999786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.000627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.002578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.035228 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 905/1791] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:25 2022] POST /identity/v3/projects => generated 389 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:26.036544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e915d6f-42ed-465f-be5e-8c323d5c876b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.050465 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e915d6f-42ed-465f-be5e-8c323d5c876b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.071356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.073399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:26.121593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.122407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.122679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.123020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.123777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.125823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.156368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c4c84-b3cc-479f-a472-9358f14baa2f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.159900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 887/1792] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:26 2022] POST /identity/v3/users => generated 301 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:26.163766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.164690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.164872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.164976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.165236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] PATH_INFO: `/v3/projects/5791300c4cf94ca58030667bacff79cb` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.166721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] RBAC: Authorizing `identity:delete_project(project_id=5791300c4cf94ca58030667bacff79cb)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.169180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.177805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477398a-18d7-4728-9042-0f95828773e3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.184469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.185203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.185482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.185753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.186484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.188380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.217200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 888/1793] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:13:26.221301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.233634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30bf0a-5773-4dbd-ac1b-6f0de0928d89 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.243664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5791300c4cf94ca58030667bacff79cb', 'request_id': 'req-e8d432ff-148d-4f18-8d21-9804c38988da'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.260657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5791300c4cf94ca58030667bacff79cb', 'request_id': 'req-e8d432ff-148d-4f18-8d21-9804c38988da'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.279728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5791300c4cf94ca58030667bacff79cb', 'request_id': 'req-e8d432ff-148d-4f18-8d21-9804c38988da'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.295045 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] The token cache is being invalidate because project 5791300c4cf94ca58030667bacff79cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:26.295343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.296014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.297635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 906/1794] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:26 2022] DELETE /identity/v3/projects/5791300c4cf94ca58030667bacff79cb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:26.301423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.303407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:26.310200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.311382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.311818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.312157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] PATH_INFO: `/v3/projects/a91706f97272457e89412550fb18e073/users/a3533a627a2246e39bcf5a6322dccb79/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.326892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91706f97272457e89412550fb18e073, user_id=a3533a627a2246e39bcf5a6322dccb79, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.329632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.347756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 889/1795] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:26 2022] PUT /identity/v3/projects/a91706f97272457e89412550fb18e073/users/a3533a627a2246e39bcf5a6322dccb79/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:26.352615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.354317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:26.361055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:26.379173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d432ff-148d-4f18-8d21-9804c38988da admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.395462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:26.434726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfc5b63-4c4a-4457-ba34-76137d5c319c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.440536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.441216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.441498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.441768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.442508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.444132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.463293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.464167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.467425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 890/1796] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:26.467546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.467546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] PATH_INFO: `/v3/users/fc4d0c3ab4114aa3b78fed5c77c1569b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.467546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4d0c3ab4114aa3b78fed5c77c1569b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.468228 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.468562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.479610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cd4e1-89ea-43aa-b872-988c7ebc1f93 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.487652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d252e4d-d439-4be3-8b7a-8b512289cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.488588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d252e4d-d439-4be3-8b7a-8b512289cf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.488871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d252e4d-d439-4be3-8b7a-8b512289cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.489315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d252e4d-d439-4be3-8b7a-8b512289cf07 admin admin] PATH_INFO: `/v3/projects/a91706f97272457e89412550fb18e073/users/a3533a627a2246e39bcf5a6322dccb79/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.491620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d252e4d-d439-4be3-8b7a-8b512289cf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91706f97272457e89412550fb18e073, user_id=a3533a627a2246e39bcf5a6322dccb79, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:26.494597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d252e4d-d439-4be3-8b7a-8b512289cf07 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:26.509695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 891/1797] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:26 2022] PUT /identity/v3/projects/a91706f97272457e89412550fb18e073/users/a3533a627a2246e39bcf5a6322dccb79/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:26.525559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761675-0aa0-4d89-be02-e75adb6167ca None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.525559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761675-0aa0-4d89-be02-e75adb6167ca None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.525559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d761675-0aa0-4d89-be02-e75adb6167ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.537462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4d0c3ab4114aa3b78fed5c77c1569b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.539198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4d0c3ab4114aa3b78fed5c77c1569b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.540348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4d0c3ab4114aa3b78fed5c77c1569b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.558373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4d0c3ab4114aa3b78fed5c77c1569b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.559583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8d761675-0aa0-4d89-be02-e75adb6167ca None None] MFA Rules not processed for user `a3533a627a2246e39bcf5a6322dccb79`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:26.560918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8d761675-0aa0-4d89-be02-e75adb6167ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:26.575596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4d0c3ab4114aa3b78fed5c77c1569b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:26.597428 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 907/1798] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:26 2022] DELETE /identity/v3/users/fc4d0c3ab4114aa3b78fed5c77c1569b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:26.760107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 892/1799] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:26.779701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:26.781627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:26.794951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.795501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.795783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:26.873842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:26.877279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:26.910043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980544f8-4ac2-400a-90f3-f9b12a978acc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:26.928676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:26.929518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:26.929904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:26.930282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:27.018618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 893/1800] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:13:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:27.041956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:27.090754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:27.092330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:27.127312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 908/1801] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:27.305514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:27.307993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:27.316481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:27.317922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:27.346339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:27.465479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e6414-1c84-4c62-9041-ca002b5fdd53 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:27.490607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:27.495059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:27.496443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:27.496727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] PATH_INFO: `/v3/projects/5bb843231f3d41b9bc2c1f518914cd52` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:27.506297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb843231f3d41b9bc2c1f518914cd52)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:27.515791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:27.518966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde03327-a992-4c04-933c-1eb5c5e26502 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:27.544393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:27.544870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:27.545152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:27.545926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:27.585911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:27.592137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:27.615172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 894/1802] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:13:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:13:27.673030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb843231f3d41b9bc2c1f518914cd52', 'request_id': 'req-ec6fbcc5-683f-4403-be12-cb8a2a00c056'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.687388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb843231f3d41b9bc2c1f518914cd52', 'request_id': 'req-ec6fbcc5-683f-4403-be12-cb8a2a00c056'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.705372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb843231f3d41b9bc2c1f518914cd52', 'request_id': 'req-ec6fbcc5-683f-4403-be12-cb8a2a00c056'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.706909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:27.708555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:27.724425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] The token cache is being invalidate because project 5bb843231f3d41b9bc2c1f518914cd52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:27.727530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.729513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec6fbcc5-683f-4403-be12-cb8a2a00c056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.738032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 909/1803] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:27 2022] DELETE /identity/v3/projects/5bb843231f3d41b9bc2c1f518914cd52 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:27.750718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7eed-6f60-4f5f-b583-01c503d44696 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:27.750718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7eed-6f60-4f5f-b583-01c503d44696 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:27.750718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c7eed-6f60-4f5f-b583-01c503d44696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:27.755721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f67eb-65d5-4911-8a34-dffd1bd694e5 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:27.837304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-197c7eed-6f60-4f5f-b583-01c503d44696 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:27.838662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-197c7eed-6f60-4f5f-b583-01c503d44696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:27.848107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:27.850076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:27.850325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:27.850612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] PATH_INFO: `/v3/users/7ae624b33f24403da5c0a6b2b9ea9f08` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:27.864209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae624b33f24403da5c0a6b2b9ea9f08)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:27.870710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:27.889666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 910/1804] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:27.892633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:27.892633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:27.893192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:27.989588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae624b33f24403da5c0a6b2b9ea9f08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.991554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae624b33f24403da5c0a6b2b9ea9f08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.992581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae624b33f24403da5c0a6b2b9ea9f08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:27.993885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:27.998612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:28.016529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae624b33f24403da5c0a6b2b9ea9f08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:28.028122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae624b33f24403da5c0a6b2b9ea9f08'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:28.038631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 911/1805] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:28.044779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:28.053691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:28.084907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 895/1806] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:27 2022] DELETE /identity/v3/users/7ae624b33f24403da5c0a6b2b9ea9f08 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:28.086230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:28.126142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c76ee-1ede-4ea6-a81e-27592edd87e9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:28.175907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:28.302511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4d4f6-f3e8-4da5-a59f-ce85c982e863 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:28.323073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9bb5-a228-4ab2-b2e3-651fa9958ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:28.323773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9bb5-a228-4ab2-b2e3-651fa9958ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:28.324080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9bb5-a228-4ab2-b2e3-651fa9958ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:28.324372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9bb5-a228-4ab2-b2e3-651fa9958ad3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:28.325125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9bb5-a228-4ab2-b2e3-651fa9958ad3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:28.325437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9bb5-a228-4ab2-b2e3-651fa9958ad3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:28.327072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9bb5-a228-4ab2-b2e3-651fa9958ad3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:28.353054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:28.354069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:28.354251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:28.354502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] PATH_INFO: `/v3/users/9425f2cb90b545c4ae9fc448c0785373` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:28.358752 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9425f2cb90b545c4ae9fc448c0785373)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:28.365735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:28.370835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:28.371162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 896/1807] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:28.372934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e90a2-f3b2-4946-a226-8ae4f496f6fe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:28.373573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e90a2-f3b2-4946-a226-8ae4f496f6fe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:28.374070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e90a2-f3b2-4946-a226-8ae4f496f6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:28.425571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-469e90a2-f3b2-4946-a226-8ae4f496f6fe None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:28.431611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-469e90a2-f3b2-4946-a226-8ae4f496f6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:28.522514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 897/1808] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:28.524607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e90a2-f3b2-4946-a226-8ae4f496f6fe None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:28.579448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e90a2-f3b2-4946-a226-8ae4f496f6fe None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:28.620345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9425f2cb90b545c4ae9fc448c0785373'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:28.620929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9425f2cb90b545c4ae9fc448c0785373'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:28.621608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9425f2cb90b545c4ae9fc448c0785373'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:28.630251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:28.631017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:28.631321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:28.631604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:28.635813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:28.637815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:28.665367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9425f2cb90b545c4ae9fc448c0785373'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:28.680161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9425f2cb90b545c4ae9fc448c0785373'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:28.709300 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 898/1809] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:28 2022] POST /identity/v3/projects => generated 387 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:28.710808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:28.711982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 912/1810] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:28 2022] DELETE /identity/v3/users/9425f2cb90b545c4ae9fc448c0785373 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:28.716343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:28.716495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:28.724391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:28.869406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37c4ff-a295-448c-809b-bdf5f1973457 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:28.870544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab25ad-4964-46f6-ac49-eb366973a16f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:28.878530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765e547-e712-4f04-ab36-f90763aacf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:28.880705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e547-e712-4f04-ab36-f90763aacf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:28.882681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e547-e712-4f04-ab36-f90763aacf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:28.884737 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765e547-e712-4f04-ab36-f90763aacf6a admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:28.886550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e547-e712-4f04-ab36-f90763aacf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:28.888542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765e547-e712-4f04-ab36-f90763aacf6a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:28.941535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 913/1811] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:28 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:28.943304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4da3f3-f176-4538-a7b1-f332340756e2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:28.953866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4da3f3-f176-4538-a7b1-f332340756e2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:28.954464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4da3f3-f176-4538-a7b1-f332340756e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.011990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-eb4da3f3-f176-4538-a7b1-f332340756e2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:29.020408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eb4da3f3-f176-4538-a7b1-f332340756e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:29.040355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 914/1812] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:29.043062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc0ea-1c8c-475f-9e8a-3e67fc7349ca None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.043906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc0ea-1c8c-475f-9e8a-3e67fc7349ca None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.044219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc0ea-1c8c-475f-9e8a-3e67fc7349ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.055330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:29.056077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.064997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.065476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.075745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:29.088323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-af4bc0ea-1c8c-475f-9e8a-3e67fc7349ca None None] MFA Rules not processed for user `d9ea56567eeb4392b5f9e5c84f16f413`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:29.089553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-af4bc0ea-1c8c-475f-9e8a-3e67fc7349ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:29.106500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:29.107991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:29.111302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 915/1813] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Jun 16 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:29.112121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc0ea-1c8c-475f-9e8a-3e67fc7349ca None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:29.135446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 899/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:29.142309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc0ea-1c8c-475f-9e8a-3e67fc7349ca None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:29.158087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:29.158811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.159098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.159377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.160130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:29.161816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:29.194943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 916/1815] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:29.196607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:29.216077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236de5c-73f3-41e3-ab24-4a0ad965b6aa service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:29.227914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:29.230696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:29.233213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:29.234777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.235066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.235347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.236094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:29.237770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:29.267254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1870ad-66e1-4142-9b36-69aeabca740d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:29.298162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:29.298979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.299394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.299802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.314117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 900/1816] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:29.317055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:29.328669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:29.330274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:29.359711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 917/1817] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:13:29.360251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cabbc7-9746-4ee4-b1a9-3e08748e4066 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:29.360619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:29.377086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a718e6f-61f2-4552-aa34-0481fdcfac51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:29.381662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718e6f-61f2-4552-aa34-0481fdcfac51 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.384060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718e6f-61f2-4552-aa34-0481fdcfac51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.384393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a718e6f-61f2-4552-aa34-0481fdcfac51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.392800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e500e15-ef5c-4a43-961c-a331170f2d01 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:29.407108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:29.408061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.408398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.408681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] PATH_INFO: `/v3/projects/225ca31e43834984a25e0f30d940e5e5/users/fb3bbcbb5c1846868e6c774b5692eb99/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.409398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a718e6f-61f2-4552-aa34-0481fdcfac51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:29.413346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a718e6f-61f2-4552-aa34-0481fdcfac51 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:29.430090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225ca31e43834984a25e0f30d940e5e5, user_id=fb3bbcbb5c1846868e6c774b5692eb99, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:29.433923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:29.441802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 901/1818] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:29.469600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49582643-93bd-45d5-8e68-e3de4be0cabc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.469951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49582643-93bd-45d5-8e68-e3de4be0cabc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.470138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 918/1819] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:29 2022] PUT /identity/v3/projects/225ca31e43834984a25e0f30d940e5e5/users/fb3bbcbb5c1846868e6c774b5692eb99/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:29.470341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49582643-93bd-45d5-8e68-e3de4be0cabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.521291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-49582643-93bd-45d5-8e68-e3de4be0cabc None None] MFA Rules not processed for user `fb3bbcbb5c1846868e6c774b5692eb99`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:29.524044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-49582643-93bd-45d5-8e68-e3de4be0cabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:29.549161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:29.689501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 902/1820] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:29.693830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:29.732980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:29.892355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b0c43-1d96-4096-966c-ac6e53d377c3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:29.905399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:29.907446 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:29.908531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:29.908867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:29.909509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:29.915803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:29.973679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 919/1821] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:29 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:29.979567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49582643-93bd-45d5-8e68-e3de4be0cabc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:30.004096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49582643-93bd-45d5-8e68-e3de4be0cabc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:30.184260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:30.184989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:30.185274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:30.185546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:30.186255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:30.188294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:30.227986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 903/1822] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:29 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:30.232146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:30.254100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a022b-f4e5-4d0a-9c2a-6816f7bbf645 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:30.265335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:30.266570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:30.266902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:30.267189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:30.268199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:30.271041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:30.307805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 920/1823] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:30.312353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:30.344403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da93a6-2c4e-4dfa-a21c-3f99a04e5b87 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:30.351546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:30.354007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:30.354460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:30.354819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] PATH_INFO: `/v3/projects/c0ab6f418deb4fc1b7be6412fe867559/users/c05ef59adbe448f5b14f661081ad4357/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:30.388463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ab6f418deb4fc1b7be6412fe867559, user_id=c05ef59adbe448f5b14f661081ad4357, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:30.394198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:30.426656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 904/1824] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:30 2022] PUT /identity/v3/projects/c0ab6f418deb4fc1b7be6412fe867559/users/c05ef59adbe448f5b14f661081ad4357/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:30.431461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:30.444143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c51f17-58cc-4f8d-be48-bec0a9fea2d5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:30.641123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cf8e3-b689-4812-991a-f553473deffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:30.642449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf8e3-b689-4812-991a-f553473deffb admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:30.642810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf8e3-b689-4812-991a-f553473deffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:30.643456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cf8e3-b689-4812-991a-f553473deffb admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:30.644788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cf8e3-b689-4812-991a-f553473deffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:30.646682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cf8e3-b689-4812-991a-f553473deffb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:30.678133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:30.678639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 921/1825] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:30.697415 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d77a220-331d-4c4e-b49e-0bcc0c3a55b5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:30.705650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:30.707419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:30.707992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:30.708682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] PATH_INFO: `/v3/projects/c0ab6f418deb4fc1b7be6412fe867559/users/c05ef59adbe448f5b14f661081ad4357/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:30.713528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ab6f418deb4fc1b7be6412fe867559, user_id=c05ef59adbe448f5b14f661081ad4357, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:30.719236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:30.748608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 905/1826] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:30 2022] PUT /identity/v3/projects/c0ab6f418deb4fc1b7be6412fe867559/users/c05ef59adbe448f5b14f661081ad4357/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:30.751031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:30.752343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:30.753519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:30.823576 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] MFA Rules not processed for user `c05ef59adbe448f5b14f661081ad4357`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:30.828712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:31.034341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 922/1827] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:31.049552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:31.051582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:31.107516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:31.109122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:31.130714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:31.241103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370e2ac-40a8-4dfe-a6a5-8007558d0436 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:31.266874 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:31.267494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:31.267780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:31.268114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:31.286392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:31.288101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:31.328794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 906/1828] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:31.330049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:31.331577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:31.346580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1e588-7b5c-4c8d-a29b-bdf82a8f4fa6 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:31.356048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f1079-c2c9-41d0-bb47-d8df64306fad service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:31.385084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:31.392840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:31.393216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:31.393504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] PATH_INFO: `/v3/projects/d8ebfca33fbd4f53956ec00c5371673a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:31.401692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ebfca33fbd4f53956ec00c5371673a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:31.407102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:31.408018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:31.408342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:31.412285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:31.420658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] PATH_INFO: `/v3/projects/33de0fcc65534358a8a0e18fc24135a8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:31.422109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33de0fcc65534358a8a0e18fc24135a8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:31.424053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:31.445060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:31.572933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ebfca33fbd4f53956ec00c5371673a', 'request_id': 'req-f81f659a-99fd-4262-9f03-249ad7654dfa'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.595960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ebfca33fbd4f53956ec00c5371673a', 'request_id': 'req-f81f659a-99fd-4262-9f03-249ad7654dfa'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.596276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33de0fcc65534358a8a0e18fc24135a8', 'request_id': 'req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.619538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ebfca33fbd4f53956ec00c5371673a', 'request_id': 'req-f81f659a-99fd-4262-9f03-249ad7654dfa'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.622047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33de0fcc65534358a8a0e18fc24135a8', 'request_id': 'req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.642379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33de0fcc65534358a8a0e18fc24135a8', 'request_id': 'req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.658061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] The token cache is being invalidate because project d8ebfca33fbd4f53956ec00c5371673a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:31.661784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.664609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.674034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 923/1829] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:31 2022] DELETE /identity/v3/projects/d8ebfca33fbd4f53956ec00c5371673a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:31.675270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:31.680089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:31.683075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] The token cache is being invalidate because project 33de0fcc65534358a8a0e18fc24135a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:31.684592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.687015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:31.695545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 907/1830] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:31 2022] DELETE /identity/v3/projects/33de0fcc65534358a8a0e18fc24135a8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:31.697028 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:31.701609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:31.857999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f659a-99fd-4262-9f03-249ad7654dfa admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:31.898127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a8be-8e3e-41f3-a681-63bd6e07e741 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:31.908438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:31.909665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:31.910724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:31.911033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] PATH_INFO: `/v3/users/eca2531ac4814d739caa06a269ce2864` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:31.915075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca2531ac4814d739caa06a269ce2864)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:31.922168 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:31.982984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:32.074326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:32.075280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:32.075610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:32.075848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] PATH_INFO: `/v3/users/fb3bbcbb5c1846868e6c774b5692eb99` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:32.079580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3bbcbb5c1846868e6c774b5692eb99)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:32.088914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:32.090408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca2531ac4814d739caa06a269ce2864'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.093632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca2531ac4814d739caa06a269ce2864'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.095683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca2531ac4814d739caa06a269ce2864'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.153695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca2531ac4814d739caa06a269ce2864'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.168783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca2531ac4814d739caa06a269ce2864'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.196932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 908/1831] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:31 2022] DELETE /identity/v3/users/eca2531ac4814d739caa06a269ce2864 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:32.197167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:32.201581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:32.209767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3bbcbb5c1846868e6c774b5692eb99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.227705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3bbcbb5c1846868e6c774b5692eb99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.232479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3bbcbb5c1846868e6c774b5692eb99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.241857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:32.285094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3bbcbb5c1846868e6c774b5692eb99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.308659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-538c1585-fc96-4db9-b7c7-3c6af2f193ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3bbcbb5c1846868e6c774b5692eb99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.348794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 924/1832] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:31 2022] DELETE /identity/v3/users/fb3bbcbb5c1846868e6c774b5692eb99 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:32.351164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4798-9f27-4e1a-a7e0-25b2fd9c5113 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:32.351460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4798-9f27-4e1a-a7e0-25b2fd9c5113 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:32.351740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b4798-9f27-4e1a-a7e0-25b2fd9c5113 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:32.357249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 925/1833] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:13:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:13:32.358704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fce5a-ecd5-4aac-91f2-453f8091b995 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:32.359000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fce5a-ecd5-4aac-91f2-453f8091b995 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:32.361882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fce5a-ecd5-4aac-91f2-453f8091b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:32.422225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1f6fce5a-ecd5-4aac-91f2-453f8091b995 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:32.423466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1f6fce5a-ecd5-4aac-91f2-453f8091b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:32.427125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885db92-66bf-4d52-bde0-2269b681fef2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:32.601302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:32.603297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:32.608881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:32.610364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] PATH_INFO: `/v3/users/a3533a627a2246e39bcf5a6322dccb79` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:32.612511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3533a627a2246e39bcf5a6322dccb79)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:32.616635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:32.625418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 926/1834] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:32.630131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:32.630461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:32.630697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:32.684118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:32.685389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:32.785067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3533a627a2246e39bcf5a6322dccb79'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.787924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3533a627a2246e39bcf5a6322dccb79'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.791073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3533a627a2246e39bcf5a6322dccb79'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.854332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3533a627a2246e39bcf5a6322dccb79'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.879068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3533a627a2246e39bcf5a6322dccb79'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:32.885436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:32.941174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 927/1835] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:13:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:32.941433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 909/1836] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:32 2022] DELETE /identity/v3/users/a3533a627a2246e39bcf5a6322dccb79 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:32.942168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:32.943535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:33.164792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a620f-61a8-474f-a2ca-6d8720f3af35 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:33.323412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:33.324394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:33.324955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:33.325380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:33.327533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:33.570174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:33.580746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:33.620632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 928/1837] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:33.829954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:33.831708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:33.895492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:33.939848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfc878-cc64-4282-bb99-6a1308338bb0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:33.948436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:33.949109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:33.949607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:33.950017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:33.979458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:33.983758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:34.042721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 910/1838] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:34.880918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:34.883396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:34.912471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:34.918097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:34.998018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ceb72-bb92-449c-8709-1385f644e7ab service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:34.999371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e88997-2df1-4ccb-b8b6-37e27091e376 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:35.006919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:35.007860 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.008240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.008494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] PATH_INFO: `/v3/projects/a91706f97272457e89412550fb18e073` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.010552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91706f97272457e89412550fb18e073)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:35.012549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:35.029793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:35.032369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.034972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.035352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] PATH_INFO: `/v3/projects/c072b0cca0cf4332af01d87bf1148f02` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.040671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c072b0cca0cf4332af01d87bf1148f02)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:35.046541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:35.182531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91706f97272457e89412550fb18e073', 'request_id': 'req-a5c79bac-cc73-4586-9fc2-937852f5d4b3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.204206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91706f97272457e89412550fb18e073', 'request_id': 'req-a5c79bac-cc73-4586-9fc2-937852f5d4b3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.230356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c072b0cca0cf4332af01d87bf1148f02', 'request_id': 'req-e6509f4a-26ee-4520-8672-1428ee7d6a7d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.236494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:35.245327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91706f97272457e89412550fb18e073', 'request_id': 'req-a5c79bac-cc73-4586-9fc2-937852f5d4b3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.253614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c072b0cca0cf4332af01d87bf1148f02', 'request_id': 'req-e6509f4a-26ee-4520-8672-1428ee7d6a7d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.272308 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] The token cache is being invalidate because project a91706f97272457e89412550fb18e073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:35.273554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.275643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a5c79bac-cc73-4586-9fc2-937852f5d4b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.277253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c072b0cca0cf4332af01d87bf1148f02', 'request_id': 'req-e6509f4a-26ee-4520-8672-1428ee7d6a7d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.281035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 911/1839] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:34 2022] DELETE /identity/v3/projects/a91706f97272457e89412550fb18e073 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:35.286753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeefd2-9d30-4d85-818d-c627aa3493db None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.286958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeefd2-9d30-4d85-818d-c627aa3493db None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.287269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aeefd2-9d30-4d85-818d-c627aa3493db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.309605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] The token cache is being invalidate because project c072b0cca0cf4332af01d87bf1148f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:35.310108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.312481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e6509f4a-26ee-4520-8672-1428ee7d6a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.322846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 929/1840] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:34 2022] DELETE /identity/v3/projects/c072b0cca0cf4332af01d87bf1148f02 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:35.324968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e9f89-87c7-4741-9b11-0212dc8a5751 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.325432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e9f89-87c7-4741-9b11-0212dc8a5751 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.325857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e9f89-87c7-4741-9b11-0212dc8a5751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.331705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-98aeefd2-9d30-4d85-818d-c627aa3493db None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:35.333101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-98aeefd2-9d30-4d85-818d-c627aa3493db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:35.372574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-015e9f89-87c7-4741-9b11-0212dc8a5751 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:35.373816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-015e9f89-87c7-4741-9b11-0212dc8a5751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:35.525986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 912/1841] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:35.527545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.527814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.528097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.558399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 930/1842] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:35.571713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b471-a9a3-4da1-afd7-b9f5aad66a04 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.572012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b471-a9a3-4da1-afd7-b9f5aad66a04 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.572347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351b471-a9a3-4da1-afd7-b9f5aad66a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.617736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:35.619463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:35.625849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b351b471-a9a3-4da1-afd7-b9f5aad66a04 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:35.627089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b351b471-a9a3-4da1-afd7-b9f5aad66a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:35.632946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 913/1843] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:35.633956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:35.636570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:35.649974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 931/1844] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:35.650929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b471-a9a3-4da1-afd7-b9f5aad66a04 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:35.662476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbe598-e9b5-4c51-a6b5-8f68cabd4059 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:35.670109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351b471-a9a3-4da1-afd7-b9f5aad66a04 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:35.673832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:35.674899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.674997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.675273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] PATH_INFO: `/v3/projects/225ca31e43834984a25e0f30d940e5e5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.686505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=225ca31e43834984a25e0f30d940e5e5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:35.698654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:35.701358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.703618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:35.705098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.705441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.706237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:35.706556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:35.710759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:35.784452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 932/1845] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:35.784895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:35.818726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886f2e4-d4ae-40ba-ae1c-61dc3e557f35 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:35.830743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:35.831554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:35.847335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:35.850000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:35.851812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:35.852978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:35.857124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:35.861591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:35.902621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225ca31e43834984a25e0f30d940e5e5', 'request_id': 'req-1dc013b3-772a-4c98-931e-df47e33900b3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.910890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 933/1846] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:35.911786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:35.924468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225ca31e43834984a25e0f30d940e5e5', 'request_id': 'req-1dc013b3-772a-4c98-931e-df47e33900b3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.943971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225ca31e43834984a25e0f30d940e5e5', 'request_id': 'req-1dc013b3-772a-4c98-931e-df47e33900b3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.946591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cc36a-ebb4-49d7-bcca-d22db65c711b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:35.982681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] The token cache is being invalidate because project 225ca31e43834984a25e0f30d940e5e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:35.982875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.985127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:35.989904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 914/1847] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:35 2022] DELETE /identity/v3/projects/225ca31e43834984a25e0f30d940e5e5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:35.993559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.001565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:36.176645 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc013b3-772a-4c98-931e-df47e33900b3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.182326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.183230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.183536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.184843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.185673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.189360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.200328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.201927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.202218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.203655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.204442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.212556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.268414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 934/1848] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:35 2022] POST /identity/v3/projects => generated 387 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:36.269526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.281117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:36.291378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 915/1849] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:35 2022] POST /identity/v3/projects => generated 373 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:36.292386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.305502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:36.370156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:36.439115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b2370d-4ab4-4167-bf19-69995521974e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.457187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48623863-88da-41a6-8e13-5318464d3205 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.457598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.458519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.458803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.459109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] PATH_INFO: `/v3/users/c05ef59adbe448f5b14f661081ad4357` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.461556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05ef59adbe448f5b14f661081ad4357)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.464868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.471131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.471866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.472159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.472459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.473166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.475121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.527263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 916/1850] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:36 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:36.528198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.555768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fde7ec9-d836-4c07-af4c-4253475d13fe admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.562302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05ef59adbe448f5b14f661081ad4357'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:36.568777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05ef59adbe448f5b14f661081ad4357'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:36.569084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.570244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05ef59adbe448f5b14f661081ad4357'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:36.570706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.570997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.571279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.572062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.574069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.593106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05ef59adbe448f5b14f661081ad4357'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:36.610156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05ef59adbe448f5b14f661081ad4357'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:36.623789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 917/1851] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:36 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:36.624594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.627661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:36.639288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 935/1852] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:36 2022] DELETE /identity/v3/users/c05ef59adbe448f5b14f661081ad4357 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:36.640273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.641723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:36.664379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed9cfa-315e-45b1-9edc-1f7b4135a482 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.711627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:DELETE=4,keystone:INSERT=8 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:36.794506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.795209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.795502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.795780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.800746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.802662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.833927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 918/1853] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:36.839939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.840533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14a17d-4fdc-4d9f-b1a9-6fb6762ed660 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.848247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.849308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.850468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.852108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.853429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.856112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.862556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2709-579d-4b4b-8564-decbdd98a890 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.876164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 936/1854] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:36.879003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.880774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.884612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.884612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.884612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.884612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.885761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.902289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8200a8-4616-4089-bf8c-cfa67fa898cd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.907995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 919/1855] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:36.912220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.913086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.913681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.914186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.915050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.917728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:36.921256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.932214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60272b7-d853-4a43-99ef-094392982a38 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.935855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 937/1856] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:36.937203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:36.946841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4fbfa-0a4c-4058-b8b9-d649a11ce8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.947775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4fbfa-0a4c-4058-b8b9-d649a11ce8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.948063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4fbfa-0a4c-4058-b8b9-d649a11ce8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.948416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4fbfa-0a4c-4058-b8b9-d649a11ce8b4 admin admin] PATH_INFO: `/v3/projects/eedf2ab520a44c7b8a919b50b5e83d7a/users/750a028349714549affef16775fa5f38/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.952076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca7782-3d65-4676-ad07-dbe4a5850ccb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:36.957912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573450d-49de-4607-862d-55ddc805d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:36.959298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573450d-49de-4607-862d-55ddc805d8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:36.959593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573450d-49de-4607-862d-55ddc805d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:36.959871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573450d-49de-4607-862d-55ddc805d8fb admin admin] PATH_INFO: `/v3/projects/57c997889f0248deb60b4af3bd260b13/users/d505423767a149b197ef117cec54b54d/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:36.989883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573450d-49de-4607-862d-55ddc805d8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c997889f0248deb60b4af3bd260b13, user_id=d505423767a149b197ef117cec54b54d, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:36.997571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4fbfa-0a4c-4058-b8b9-d649a11ce8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eedf2ab520a44c7b8a919b50b5e83d7a, user_id=750a028349714549affef16775fa5f38, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:37.000302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4fbfa-0a4c-4058-b8b9-d649a11ce8b4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:37.003283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573450d-49de-4607-862d-55ddc805d8fb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:37.051277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 938/1857] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:36 2022] PUT /identity/v3/projects/57c997889f0248deb60b4af3bd260b13/users/d505423767a149b197ef117cec54b54d/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:37.052058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 920/1858] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:36 2022] PUT /identity/v3/projects/eedf2ab520a44c7b8a919b50b5e83d7a/users/750a028349714549affef16775fa5f38/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:37.052155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.052155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.052155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.053116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c665e8-e56c-4225-a486-778225672ffb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.053420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c665e8-e56c-4225-a486-778225672ffb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.053819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c665e8-e56c-4225-a486-778225672ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.087159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:37.089804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:37.107210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:37.137260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a2c665e8-e56c-4225-a486-778225672ffb None None] MFA Rules not processed for user `750a028349714549affef16775fa5f38`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:37.138528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a2c665e8-e56c-4225-a486-778225672ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:37.220503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 939/1859] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:37.278893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:37.284636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:37.364026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 921/1860] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:37.369113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c665e8-e56c-4225-a486-778225672ffb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:37.403127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c665e8-e56c-4225-a486-778225672ffb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:37.417987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:37.418782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.419151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.421140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.422115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:37.427848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:37.438103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a508c4-4b63-4601-b807-d1b2e31d0614 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:37.452803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:37.454299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.456793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.457307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.476413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:37.478292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:37.495832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 922/1861] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:37 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:37.496514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 940/1862] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:13:37.499900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:37.517213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6cab3-2f89-4504-9779-f5ee0306c260 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:37.643706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:37.644436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.644722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.645016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.645762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:37.647747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:37.693686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:37.695626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 941/1863] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:37 2022] POST /identity/v3/users => generated 299 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:13:37.715072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e890-0e9a-46fd-b611-ef2e3bb5a776 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:37.747099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618270e5-1b78-4048-947b-e4334f77f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:37.752218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618270e5-1b78-4048-947b-e4334f77f77e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.752831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618270e5-1b78-4048-947b-e4334f77f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.756782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618270e5-1b78-4048-947b-e4334f77f77e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.758031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618270e5-1b78-4048-947b-e4334f77f77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:37.768009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618270e5-1b78-4048-947b-e4334f77f77e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:37.795853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:37.808435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 923/1864] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:37.821916 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4642f-7fef-4111-9984-14bfefd96a6f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:37.837879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:37.841011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.843101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.843550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] PATH_INFO: `/v3/projects/407c2d45dbaa499a8f36f64f11b6ec9a/users/b416acad213443c88e1024e5ce2ba891/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.868061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407c2d45dbaa499a8f36f64f11b6ec9a, user_id=b416acad213443c88e1024e5ce2ba891, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:37.871557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:37.907748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500965-b956-4b24-9cb4-0bc89ca73714 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.908377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500965-b956-4b24-9cb4-0bc89ca73714 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.909240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c500965-b956-4b24-9cb4-0bc89ca73714 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.911282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 924/1865] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:13:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:13:37.920006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735398-59ae-4961-a760-a3abffbaa992 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:37.920663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735398-59ae-4961-a760-a3abffbaa992 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:37.921167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df735398-59ae-4961-a760-a3abffbaa992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:37.931886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 942/1866] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:37 2022] PUT /identity/v3/projects/407c2d45dbaa499a8f36f64f11b6ec9a/users/b416acad213443c88e1024e5ce2ba891/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:37.936501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:37.984127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-df735398-59ae-4961-a760-a3abffbaa992 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:37.987306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-df735398-59ae-4961-a760-a3abffbaa992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:37.998944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:38.068577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:38.183807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69453-5a1d-46d3-a6c9-1548e5d6b331 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:38.199496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 925/1867] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:38.240224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fd966-85a8-4ec9-8c3a-042f1cfeb937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:38.243708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd966-85a8-4ec9-8c3a-042f1cfeb937 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:38.245042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd966-85a8-4ec9-8c3a-042f1cfeb937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:38.246370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fd966-85a8-4ec9-8c3a-042f1cfeb937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:38.256444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fd966-85a8-4ec9-8c3a-042f1cfeb937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:38.262959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375fd966-85a8-4ec9-8c3a-042f1cfeb937 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:38.299893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 943/1868] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:38.304044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df735398-59ae-4961-a760-a3abffbaa992 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:38.325219 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df735398-59ae-4961-a760-a3abffbaa992 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:38.347124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:38.348336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:38.349378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:38.349858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] PATH_INFO: `/v3/projects/407c2d45dbaa499a8f36f64f11b6ec9a/users/b416acad213443c88e1024e5ce2ba891/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:38.357404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=407c2d45dbaa499a8f36f64f11b6ec9a, user_id=b416acad213443c88e1024e5ce2ba891, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:38.367888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:38.398583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 926/1869] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:38 2022] PUT /identity/v3/projects/407c2d45dbaa499a8f36f64f11b6ec9a/users/b416acad213443c88e1024e5ce2ba891/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:38.400690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:38.401842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:38.402229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:38.470041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] MFA Rules not processed for user `b416acad213443c88e1024e5ce2ba891`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:38.475283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:38.756477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 944/1870] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:38.768273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:38.770508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:38.922220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78965d74-a433-49fd-8869-8412d38df81e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:38.940070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:38.948407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:38.948407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:38.948407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:38.974302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:38.976616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:39.016218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:39.018389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:39.026143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 927/1871] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:39.081022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:39.083046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:39.193269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d589c-c6f2-418d-ab1c-9990a8673818 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:39.202665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110727ad-c8e6-4641-ad45-ddca6822478a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:39.219003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110727ad-c8e6-4641-ad45-ddca6822478a service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:39.219397 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110727ad-c8e6-4641-ad45-ddca6822478a service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:39.219891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110727ad-c8e6-4641-ad45-ddca6822478a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:39.240047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110727ad-c8e6-4641-ad45-ddca6822478a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:39.244934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110727ad-c8e6-4641-ad45-ddca6822478a service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:39.264446 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 945/1872] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:39.351925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5921-5593-4df4-9d69-33a0cd656106 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:39.371135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:39.373107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:39.374088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:39.375372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] PATH_INFO: `/v3/projects/c0ab6f418deb4fc1b7be6412fe867559` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:39.380094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ab6f418deb4fc1b7be6412fe867559)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:39.387823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:39.486777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ab6f418deb4fc1b7be6412fe867559', 'request_id': 'req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:39.497978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ab6f418deb4fc1b7be6412fe867559', 'request_id': 'req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:39.538891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ab6f418deb4fc1b7be6412fe867559', 'request_id': 'req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:39.552618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:39.592137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] The token cache is being invalidate because project c0ab6f418deb4fc1b7be6412fe867559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:39.592463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:39.595000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ad2bbe25-c9bc-48ea-9bce-89dc7900de12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:39.606155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 928/1873] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:39 2022] DELETE /identity/v3/projects/c0ab6f418deb4fc1b7be6412fe867559 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:39.609768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8783-7f8d-4c5c-a22f-161b54c06812 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:39.610727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8783-7f8d-4c5c-a22f-161b54c06812 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:39.611012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8783-7f8d-4c5c-a22f-161b54c06812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:39.669060 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-fc9a8783-7f8d-4c5c-a22f-161b54c06812 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:39.670689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fc9a8783-7f8d-4c5c-a22f-161b54c06812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:39.750052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:39.864513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 946/1874] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:39.873982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08472-50a9-4a74-b8f0-06dc4ed21487 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:39.874373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08472-50a9-4a74-b8f0-06dc4ed21487 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:39.874741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08472-50a9-4a74-b8f0-06dc4ed21487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:39.947307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-16f08472-50a9-4a74-b8f0-06dc4ed21487 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:39.952600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-16f08472-50a9-4a74-b8f0-06dc4ed21487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:39.991056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 929/1875] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:39.996728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8783-7f8d-4c5c-a22f-161b54c06812 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.012002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8783-7f8d-4c5c-a22f-161b54c06812 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.028918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.032108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.033384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.034478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.036056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:40.037268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.042793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.094858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 947/1876] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:40.099816 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08472-50a9-4a74-b8f0-06dc4ed21487 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.115722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08472-50a9-4a74-b8f0-06dc4ed21487 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.123612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.125120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.125626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.126136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.127620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.130332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.170607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 930/1877] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:40 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:40.174461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.187157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a8003-c2f8-4c0f-a473-356aa50e0d84 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.352469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.354413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.354413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.354413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.355362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.358307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.425304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.428769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 948/1878] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:40 2022] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:40.440578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb96a50-875b-4964-ba12-1faea08bc887 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.455290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.456328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.456807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.457510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.461591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.464916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.485971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.492838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 931/1879] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:40.497090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ea8a-82c1-48c3-9c42-a776b6f0a6dd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.511233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.513283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.513577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.513856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.514603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.516423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.543187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.543803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 949/1880] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:40.560220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc707d7e-6ee9-490a-b9cc-6453adcd2dd9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.568077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ba616-73a5-4348-9457-565e51abd34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.569116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba616-73a5-4348-9457-565e51abd34c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.569969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba616-73a5-4348-9457-565e51abd34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.570250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ba616-73a5-4348-9457-565e51abd34c admin admin] PATH_INFO: `/v3/projects/310b0061b6d84207a48b5ac1774221c2/users/d2a9e8f491b24f0a8c161f1f934996da/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.574615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.576724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:40.590294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba616-73a5-4348-9457-565e51abd34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=310b0061b6d84207a48b5ac1774221c2, user_id=d2a9e8f491b24f0a8c161f1f934996da, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.592872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729211a5-d029-476f-bf07-eb73a734fc19 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.593409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ba616-73a5-4348-9457-565e51abd34c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.603558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.604890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.605359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.606609 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] PATH_INFO: `/v3/users/750a028349714549affef16775fa5f38` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.608464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=750a028349714549affef16775fa5f38)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.611179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.612067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 932/1881] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:40 2022] PUT /identity/v3/projects/310b0061b6d84207a48b5ac1774221c2/users/d2a9e8f491b24f0a8c161f1f934996da/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:40.623913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.624230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.624656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.671900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] MFA Rules not processed for user `d2a9e8f491b24f0a8c161f1f934996da`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:40.673418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:40.681290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750a028349714549affef16775fa5f38'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:40.682322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750a028349714549affef16775fa5f38'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:40.683128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750a028349714549affef16775fa5f38'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:40.699856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750a028349714549affef16775fa5f38'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:40.716588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2a6ae197-84ec-4a97-9197-b8312b1894a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750a028349714549affef16775fa5f38'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:40.749872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 950/1882] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:40 2022] DELETE /identity/v3/users/750a028349714549affef16775fa5f38 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:40.752103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.752428 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.753189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.766865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:40.774897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:40.776439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:40.777231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 933/1883] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:40.781866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.782562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:40.852220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 951/1884] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:40.868363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.870727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:40.890596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbabee-e662-4bed-9830-254f24c13591 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.896819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:40.898262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:40.898548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:40.898833 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:40.899537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:40.901561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:40.953487 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 934/1885] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:40 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:13:40.954122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ec1fa-be5c-496f-848c-6699834a9e45 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:40.956989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:40.967118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:41.045035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.046860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.047314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.048165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.073393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54822b-908b-43b8-ae24-ade5d3df67c0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.079810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af779d7-72a3-4067-990d-c1226e384992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.081712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af779d7-72a3-4067-990d-c1226e384992 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.082326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af779d7-72a3-4067-990d-c1226e384992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.082814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af779d7-72a3-4067-990d-c1226e384992 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.084413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af779d7-72a3-4067-990d-c1226e384992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.088160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af779d7-72a3-4067-990d-c1226e384992 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.113248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 935/1886] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:40 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:41.115634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.116160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.117176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.138362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.139808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.145125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] MFA Rules not processed for user `d505423767a149b197ef117cec54b54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:41.146476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:41.150615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 952/1887] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:13:41.151578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.166348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053c982-3847-4cff-bfa0-3d92a6cb6fa0 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.173077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.174028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.174324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.174603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.175333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.177241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.191476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 953/1888] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:41.192506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.197871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:41.204198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a89bad-e3a1-43ee-872a-ab539adfccf3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.211071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.212094 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.212435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.212849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] PATH_INFO: `/v3/projects/9f45f508a97e486cba11969aaebe175b/users/d00895b8a0654cadb342c42947c982c2/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.226647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 936/1889] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:41.232360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.232686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f45f508a97e486cba11969aaebe175b, user_id=d00895b8a0654cadb342c42947c982c2, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.234054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:41.236107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.250847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750be7ce-cd3f-4bde-883a-1e03d3eccad3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.253099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 954/1890] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:41 2022] PUT /identity/v3/projects/9f45f508a97e486cba11969aaebe175b/users/d00895b8a0654cadb342c42947c982c2/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:41.258927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.328186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.328970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.329537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.329890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.331439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.335381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.354658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81cb3-6756-44b4-983d-52aac0e79f54 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.361487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.363779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.364893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.365540 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.367238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.369441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.374959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 937/1891] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:41 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:13:41.376383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.384941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 955/1892] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:41.388847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.389650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:41.402860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179806d-334d-4bf5-b76e-a78f56320ea4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.462910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3a370-e5d2-4350-aa00-7c756ef54ac6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.476994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.478061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.478456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.479078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.480580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.482077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee504ad-250c-4b73-a20e-0750e517c5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.483169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.484097 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee504ad-250c-4b73-a20e-0750e517c5cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.484852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee504ad-250c-4b73-a20e-0750e517c5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.485291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee504ad-250c-4b73-a20e-0750e517c5cb admin admin] PATH_INFO: `/v3/projects/9f45f508a97e486cba11969aaebe175b/users/d00895b8a0654cadb342c42947c982c2/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.498651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee504ad-250c-4b73-a20e-0750e517c5cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f45f508a97e486cba11969aaebe175b, user_id=d00895b8a0654cadb342c42947c982c2, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.501641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee504ad-250c-4b73-a20e-0750e517c5cb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.511091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 938/1893] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:41 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:41.514597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.525180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 956/1894] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:41 2022] PUT /identity/v3/projects/9f45f508a97e486cba11969aaebe175b/users/d00895b8a0654cadb342c42947c982c2/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:41.531556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935cc422-0f29-4f38-868e-b94689280d09 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.536664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d385f4-8fdc-47d0-9975-89829fc82c0c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.539578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d385f4-8fdc-47d0-9975-89829fc82c0c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.539578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d385f4-8fdc-47d0-9975-89829fc82c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.608736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a4d385f4-8fdc-47d0-9975-89829fc82c0c None None] MFA Rules not processed for user `d00895b8a0654cadb342c42947c982c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:41.616738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a4d385f4-8fdc-47d0-9975-89829fc82c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:41.628600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.630050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.630050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.630050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.630787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.633221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.645536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 939/1895] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:41.649425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.662537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:41.680852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1be4f1-bbcb-490d-bf5b-33e3ff06bd6b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.691674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.693156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.693515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.693866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] PATH_INFO: `/v3/projects/eedf2ab520a44c7b8a919b50b5e83d7a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.696451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=eedf2ab520a44c7b8a919b50b5e83d7a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.698669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.721819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:41.750827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 957/1896] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:41.751517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d385f4-8fdc-47d0-9975-89829fc82c0c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.764639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d385f4-8fdc-47d0-9975-89829fc82c0c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.776770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eedf2ab520a44c7b8a919b50b5e83d7a', 'request_id': 'req-ef11b024-3428-4784-8fd0-0facf23dadbe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:41.784408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eedf2ab520a44c7b8a919b50b5e83d7a', 'request_id': 'req-ef11b024-3428-4784-8fd0-0facf23dadbe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:41.794095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eedf2ab520a44c7b8a919b50b5e83d7a', 'request_id': 'req-ef11b024-3428-4784-8fd0-0facf23dadbe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:41.806861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] The token cache is being invalidate because project eedf2ab520a44c7b8a919b50b5e83d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:41.807295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:41.807980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:41.809937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 940/1897] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:41 2022] DELETE /identity/v3/projects/eedf2ab520a44c7b8a919b50b5e83d7a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:41.810550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.813751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:41.836082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:41.837687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.838639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.838929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.839209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] PATH_INFO: `/v3/projects/14b98956d6a147a89ee56c4d03a18be0/users/75ebf52917f646e9bbd6b25a685a589f/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.858807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b98956d6a147a89ee56c4d03a18be0, user_id=75ebf52917f646e9bbd6b25a685a589f, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.861775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:41.886847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 958/1898] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:41 2022] PUT /identity/v3/projects/14b98956d6a147a89ee56c4d03a18be0/users/75ebf52917f646e9bbd6b25a685a589f/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:41.886847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:41.889951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:41.893620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11b024-3428-4784-8fd0-0facf23dadbe admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.955550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.956250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.956535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.956818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.958657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:41.974089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837968-b5db-4bca-b52d-f2c3229c3481 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:41.979746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:41.980876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:41.981168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:41.981452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] PATH_INFO: `/v3/users/b416acad213443c88e1024e5ce2ba891` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:41.982692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b416acad213443c88e1024e5ce2ba891)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:41.989786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:42.036673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:42.038727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:42.049754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 941/1899] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:42.051251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:42.053656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:42.062513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b416acad213443c88e1024e5ce2ba891'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.063690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b416acad213443c88e1024e5ce2ba891'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.065354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b416acad213443c88e1024e5ce2ba891'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.068641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52227a0a-3c7e-4fdc-a5da-0eedb1d5c466 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:42.075252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:42.076423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:42.076869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:42.077154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:42.077899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:42.078970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b416acad213443c88e1024e5ce2ba891'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.079650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:42.088751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b416acad213443c88e1024e5ce2ba891'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.093839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 942/1900] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:42.097119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:42.100247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:42.100428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:42.110041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 959/1901] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:41 2022] DELETE /identity/v3/users/b416acad213443c88e1024e5ce2ba891 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:42.118308 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2dba0-ac51-4066-807b-e03daf90e10d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:42.188682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:42.189823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:42.192322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:42.192322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] PATH_INFO: `/v3/projects/14b98956d6a147a89ee56c4d03a18be0/users/75ebf52917f646e9bbd6b25a685a589f/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:42.192611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b98956d6a147a89ee56c4d03a18be0, user_id=75ebf52917f646e9bbd6b25a685a589f, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:42.195467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:42.209438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 943/1902] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:42 2022] PUT /identity/v3/projects/14b98956d6a147a89ee56c4d03a18be0/users/75ebf52917f646e9bbd6b25a685a589f/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:42.480941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:42.482630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:42.520644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dd586-5172-4637-ab2f-e0b53f1e5ce8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:42.528459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:42.530672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:42.540590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:42.636476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:42.639138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:42.639327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:42.639614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] PATH_INFO: `/v3/projects/407c2d45dbaa499a8f36f64f11b6ec9a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:42.642052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407c2d45dbaa499a8f36f64f11b6ec9a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:42.646743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:42.670771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8f8dd-623e-4412-8fb3-bb2272bf05a1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:42.696840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd00895b8a0654cadb342c42947c982c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f508a97e486cba11969aaebe175b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:42.700819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:42.701172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:42.701459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:42.704730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:42.705591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:42.709184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:42.745132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 944/1903] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:13:42.748846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:42.761387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0605265-6ef1-4c82-b5f6-44daec57ade7 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:42.777341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407c2d45dbaa499a8f36f64f11b6ec9a', 'request_id': 'req-c356e20c-acb7-4a43-97f8-f42211e68b71'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.791065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407c2d45dbaa499a8f36f64f11b6ec9a', 'request_id': 'req-c356e20c-acb7-4a43-97f8-f42211e68b71'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.805117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407c2d45dbaa499a8f36f64f11b6ec9a', 'request_id': 'req-c356e20c-acb7-4a43-97f8-f42211e68b71'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.826504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] The token cache is being invalidate because project 407c2d45dbaa499a8f36f64f11b6ec9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:42.827066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.828398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c356e20c-acb7-4a43-97f8-f42211e68b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:42.830766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 960/1904] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:42 2022] DELETE /identity/v3/projects/407c2d45dbaa499a8f36f64f11b6ec9a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:42.836058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80ae3-62fe-4055-833e-f59a4cf7d613 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:42.836484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80ae3-62fe-4055-833e-f59a4cf7d613 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:42.836773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80ae3-62fe-4055-833e-f59a4cf7d613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:42.862231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd00895b8a0654cadb342c42947c982c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f508a97e486cba11969aaebe175b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:42.863215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:42.863671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:42.864305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:42.865297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:42.869533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:42.873343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e1a80ae3-62fe-4055-833e-f59a4cf7d613 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:42.875452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e1a80ae3-62fe-4055-833e-f59a4cf7d613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:42.915920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 945/1905] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:42 2022] POST /identity/v3/projects => generated 355 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:42.916762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:42.918890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:42.966800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 961/1906] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:42.977435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3791bbc-81ec-4abf-8756-86a066d4d84c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:42.978246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3791bbc-81ec-4abf-8756-86a066d4d84c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:42.980202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3791bbc-81ec-4abf-8756-86a066d4d84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.014749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f3791bbc-81ec-4abf-8756-86a066d4d84c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:43.016236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f3791bbc-81ec-4abf-8756-86a066d4d84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:43.082162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:43.105845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdae4c-ceb6-4970-9b44-a387ecd6b27b tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.111840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd00895b8a0654cadb342c42947c982c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f508a97e486cba11969aaebe175b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.112713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.114242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.114634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.115765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:43.116241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.119114 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.135131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 946/1907] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:43.156942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 962/1908] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:43.161606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.176104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb793d3-d8c8-40bf-ab24-61a4670f0f38 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.179323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3791bbc-81ec-4abf-8756-86a066d4d84c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.181233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.181906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.182210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.182494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.183226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:43.183662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.186106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.194941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3791bbc-81ec-4abf-8756-86a066d4d84c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.202226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd00895b8a0654cadb342c42947c982c2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f45f508a97e486cba11969aaebe175b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.203443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.203737 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.203985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] PATH_INFO: `/v3/projects/a904d2d6f324450bb025f12de85e49a9` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.207428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 947/1909] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:43.207580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a904d2d6f324450bb025f12de85e49a9)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.207580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.208499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.217205 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:43.226948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84ce7-aa33-4cfc-ad28-0235c21a9122 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.234344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.235433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.235727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.236238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.237676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.239665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.278609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 948/1910] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:43 2022] POST /identity/v3/projects => generated 361 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:13:43.285781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.300007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a904d2d6f324450bb025f12de85e49a9', 'request_id': 'req-f580e23f-8183-41f4-a03e-3f0c03650f27'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.318247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a904d2d6f324450bb025f12de85e49a9', 'request_id': 'req-f580e23f-8183-41f4-a03e-3f0c03650f27'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.329990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a904d2d6f324450bb025f12de85e49a9', 'request_id': 'req-f580e23f-8183-41f4-a03e-3f0c03650f27'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.348458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] The token cache is being invalidate because project a904d2d6f324450bb025f12de85e49a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:43.348993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.349672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.352846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 963/1911] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:43 2022] DELETE /identity/v3/projects/a904d2d6f324450bb025f12de85e49a9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:43.395254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae87382-1488-4111-b316-04622b6103ac admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.402163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.402884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.403173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.403499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.404144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.406375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.433759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 949/1912] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:43 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:43.438137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.439803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:43.518587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580e23f-8183-41f4-a03e-3f0c03650f27 tempest-VolumeQuotaClassesTest-1646003698 tempest-VolumeQuotaClassesTest-1646003698-project-admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.523969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.524617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.524925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.525567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.525947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.528018 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.549299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 964/1913] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:43.553424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.564314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ff18a-e118-44c2-b90d-8c3a91d0ae80 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.569399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.570278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.570570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.570852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.571703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.573601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.587067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 950/1914] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:43.591272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.603114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3e5e3-aa6d-4cd6-94e1-e0e7483c9e87 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.611510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e58d5-6d86-4520-a161-370bf0d6f711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.612347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e58d5-6d86-4520-a161-370bf0d6f711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.613011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e58d5-6d86-4520-a161-370bf0d6f711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.613011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e58d5-6d86-4520-a161-370bf0d6f711 admin admin] PATH_INFO: `/v3/projects/b6a1b6b181364f95a89fdd2e64133172/users/82d608705bb94ca1b3dc09162660593a/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.631708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e58d5-6d86-4520-a161-370bf0d6f711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a1b6b181364f95a89fdd2e64133172, user_id=82d608705bb94ca1b3dc09162660593a, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.634912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e58d5-6d86-4520-a161-370bf0d6f711 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.635872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.643944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:43.656606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 965/1915] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:43 2022] PUT /identity/v3/projects/b6a1b6b181364f95a89fdd2e64133172/users/82d608705bb94ca1b3dc09162660593a/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:43.658345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356870-e2d1-481b-b4c3-1d6b07b1c29f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.658869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356870-e2d1-481b-b4c3-1d6b07b1c29f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.659351 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39356870-e2d1-481b-b4c3-1d6b07b1c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.667558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f775e-72eb-4fff-88c9-e40e1a5acebc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:43.701844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-39356870-e2d1-481b-b4c3-1d6b07b1c29f None None] MFA Rules not processed for user `75ebf52917f646e9bbd6b25a685a589f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:43.704021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-39356870-e2d1-481b-b4c3-1d6b07b1c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:43.718200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:43.740282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:43.741990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.742544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.743088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] PATH_INFO: `/v3/users/d2a9e8f491b24f0a8c161f1f934996da` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.744823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a9e8f491b24f0a8c161f1f934996da)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:43.747023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:43.830194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 966/1916] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:43.832248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f1dd-c23d-4a33-8985-841821f7dacb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:43.832967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f1dd-c23d-4a33-8985-841821f7dacb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:43.844660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed33f1dd-c23d-4a33-8985-841821f7dacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:43.856464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a9e8f491b24f0a8c161f1f934996da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.858065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a9e8f491b24f0a8c161f1f934996da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.859989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a9e8f491b24f0a8c161f1f934996da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.885315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:43.889991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a9e8f491b24f0a8c161f1f934996da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.904331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a9e8f491b24f0a8c161f1f934996da'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:43.910232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ed33f1dd-c23d-4a33-8985-841821f7dacb None None] MFA Rules not processed for user `82d608705bb94ca1b3dc09162660593a`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:43.914014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ed33f1dd-c23d-4a33-8985-841821f7dacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:43.923016 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 951/1917] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:43 2022] DELETE /identity/v3/users/d2a9e8f491b24f0a8c161f1f934996da => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:43.924124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:43.926924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.008323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 967/1918] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:44.011209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:44.011634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:44.011920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:44.024583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18f5ee-e2d9-4478-b19e-35f8fc36a893 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:44.031309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:44.040544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:44.040931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:44.041156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:44.043642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.045239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:44.046837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.120002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:44.121579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:44.123757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 968/1919] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:44.124959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:44.126538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.137288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 952/1920] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:44.138228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:44.139613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.140399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19957d89-a009-4fc3-a6f5-207255233aa1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:44.145010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:44.145825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:44.145918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:44.146254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:44.217933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:44.220330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ecbc1-7535-4346-aa89-42799e354f11 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:44.226099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3de050-04a4-4008-8a05-45b5450a4a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:44.227499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3de050-04a4-4008-8a05-45b5450a4a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:44.227772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3de050-04a4-4008-8a05-45b5450a4a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:44.228162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3de050-04a4-4008-8a05-45b5450a4a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:44.244092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3de050-04a4-4008-8a05-45b5450a4a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:44.246696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3de050-04a4-4008-8a05-45b5450a4a3e service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:44.251203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:44.253009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:44.267071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 969/1922] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:44.268357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 953/1921] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:44.281084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:44.282550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.297695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373a0f-dc21-4b7c-833e-4c87294fdba2 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:44.302523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:44.303497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:44.304455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:44.304905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] PATH_INFO: `/v3/users/82d608705bb94ca1b3dc09162660593a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:44.306152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d608705bb94ca1b3dc09162660593a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:44.308148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:44.390092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d608705bb94ca1b3dc09162660593a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:44.390762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d608705bb94ca1b3dc09162660593a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:44.391718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d608705bb94ca1b3dc09162660593a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:44.409681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d608705bb94ca1b3dc09162660593a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:44.422896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d608705bb94ca1b3dc09162660593a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:44.451108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 970/1923] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:44 2022] DELETE /identity/v3/users/82d608705bb94ca1b3dc09162660593a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:44.455603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:44.456167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:44.456322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:44.486153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:44.486379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.549911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:44.636435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 954/1924] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:44.648081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:44.649774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:44.779286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28bc7f-915b-426e-8f80-5eb98e68452d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:44.783522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:44.784199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:44.784508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:44.785348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:44.795389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:44.796887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:44.807504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 971/1925] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:45.137460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:45.139510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:45.174630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d07b7-ced0-4fbd-acf1-34a174093d68 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:45.181593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:45.182673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:45.183167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:45.183553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] PATH_INFO: `/v3/projects/310b0061b6d84207a48b5ac1774221c2` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:45.185106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=310b0061b6d84207a48b5ac1774221c2)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:45.189356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:45.410844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310b0061b6d84207a48b5ac1774221c2', 'request_id': 'req-84b33fde-897a-469d-85cb-12adb1fdd20b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.419962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310b0061b6d84207a48b5ac1774221c2', 'request_id': 'req-84b33fde-897a-469d-85cb-12adb1fdd20b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.430184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310b0061b6d84207a48b5ac1774221c2', 'request_id': 'req-84b33fde-897a-469d-85cb-12adb1fdd20b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.449459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] The token cache is being invalidate because project 310b0061b6d84207a48b5ac1774221c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:45.449459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.456394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.456394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 955/1926] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:45 2022] DELETE /identity/v3/projects/310b0061b6d84207a48b5ac1774221c2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:45.462898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:45.501605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4f2d1-db39-4b05-8908-f2981d1033bf service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:45.639472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:45.653733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:45.654783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:45.655161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:45.655512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] PATH_INFO: `/v3/users/d00895b8a0654cadb342c42947c982c2` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:45.657602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00895b8a0654cadb342c42947c982c2)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:45.659763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:45.730649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00895b8a0654cadb342c42947c982c2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.731432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00895b8a0654cadb342c42947c982c2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.732115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00895b8a0654cadb342c42947c982c2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.748361 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00895b8a0654cadb342c42947c982c2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.764606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00895b8a0654cadb342c42947c982c2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:45.778564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:45.780875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:45.800338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 972/1927] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:45 2022] DELETE /identity/v3/users/d00895b8a0654cadb342c42947c982c2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:45.861400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b33fde-897a-469d-85cb-12adb1fdd20b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:45.932604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:45.934877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:45.935278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:45.936148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:45.939674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:45.994869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:46.040209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:46.042287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:46.085721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 956/1928] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:13:46.323137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.325613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.446291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c31c02-b737-4b1b-bd98-7ffde37d90db admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:46.453569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:46.454494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.454809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.455083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] PATH_INFO: `/v3/projects/9f45f508a97e486cba11969aaebe175b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.456324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f45f508a97e486cba11969aaebe175b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:46.458238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:46.517204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.520027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.528501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f45f508a97e486cba11969aaebe175b', 'request_id': 'req-f6e672cc-409a-4426-8fe4-a07f648bfb08'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.536114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f45f508a97e486cba11969aaebe175b', 'request_id': 'req-f6e672cc-409a-4426-8fe4-a07f648bfb08'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.540923 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ad0b2-fdef-404b-84ba-24a8fb7a3271 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:46.546698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f45f508a97e486cba11969aaebe175b', 'request_id': 'req-f6e672cc-409a-4426-8fe4-a07f648bfb08'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.556780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:46.562489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] The token cache is being invalidate because project 9f45f508a97e486cba11969aaebe175b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:46.563027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.565032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f6e672cc-409a-4426-8fe4-a07f648bfb08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.567746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 973/1929] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:46 2022] DELETE /identity/v3/projects/9f45f508a97e486cba11969aaebe175b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:46.580435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90bda-1a79-477a-985b-116bebcd3686 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.580435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90bda-1a79-477a-985b-116bebcd3686 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.580435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b90bda-1a79-477a-985b-116bebcd3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.599498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f1b90bda-1a79-477a-985b-116bebcd3686 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:46.602091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f1b90bda-1a79-477a-985b-116bebcd3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.612693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:46.613740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.614074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.614346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] PATH_INFO: `/v3/projects/b6a1b6b181364f95a89fdd2e64133172` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.615534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a1b6b181364f95a89fdd2e64133172)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:46.618457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:46.674413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 974/1930] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:46.683762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96c5a-ff80-45ac-9657-61963120cec3 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.684338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96c5a-ff80-45ac-9657-61963120cec3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.684544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a1b6b181364f95a89fdd2e64133172', 'request_id': 'req-32a9d64d-fbd4-4506-9283-37873fa6f357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.685452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d96c5a-ff80-45ac-9657-61963120cec3 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.687135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 975/1931] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:13:46 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:13:46.688416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a8fc8-70b4-494c-abfb-714737f318d1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.688708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a8fc8-70b4-494c-abfb-714737f318d1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.689313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a8fc8-70b4-494c-abfb-714737f318d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.691831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a1b6b181364f95a89fdd2e64133172', 'request_id': 'req-32a9d64d-fbd4-4506-9283-37873fa6f357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.704943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a1b6b181364f95a89fdd2e64133172', 'request_id': 'req-32a9d64d-fbd4-4506-9283-37873fa6f357'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.715509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-aa9a8fc8-70b4-494c-abfb-714737f318d1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:46.716879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-aa9a8fc8-70b4-494c-abfb-714737f318d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.717100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] The token cache is being invalidate because project b6a1b6b181364f95a89fdd2e64133172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:13:46.717394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.718048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-32a9d64d-fbd4-4506-9283-37873fa6f357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:46.719946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 957/1932] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:13:46 2022] DELETE /identity/v3/projects/b6a1b6b181364f95a89fdd2e64133172 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:46.727579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b26329-650b-4ea9-98b5-dc897afacaeb None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.727875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b26329-650b-4ea9-98b5-dc897afacaeb None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.728180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b26329-650b-4ea9-98b5-dc897afacaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.747879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-28b26329-650b-4ea9-98b5-dc897afacaeb None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:46.749148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-28b26329-650b-4ea9-98b5-dc897afacaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.813163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 976/1933] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:46.818576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:46.821574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.822186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.822543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.844193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 958/1934] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:46.845391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b26329-650b-4ea9-98b5-dc897afacaeb None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.847527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:46.849110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.857969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b26329-650b-4ea9-98b5-dc897afacaeb None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:46.864474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc794887-1bd5-489a-b9dc-0a691b815d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:46.865022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 977/1935] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:46.865157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc794887-1bd5-489a-b9dc-0a691b815d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.865423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc794887-1bd5-489a-b9dc-0a691b815d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.865706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc794887-1bd5-489a-b9dc-0a691b815d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.865937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.867209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc794887-1bd5-489a-b9dc-0a691b815d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:46.867802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.868019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc794887-1bd5-489a-b9dc-0a691b815d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:46.869671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc794887-1bd5-489a-b9dc-0a691b815d0b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:46.883976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44171c1a-43dc-4182-a7b4-3509a03d8a5d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:46.890208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 959/1936] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:46.890866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:46.891573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70e166-050a-4b39-8191-4a008a81a65b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.891868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70e166-050a-4b39-8191-4a008a81a65b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.892148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70e166-050a-4b39-8191-4a008a81a65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.892362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.892704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.892990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.905534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:46.907204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:46.915030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4b70e166-050a-4b39-8191-4a008a81a65b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:46.916279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4b70e166-050a-4b39-8191-4a008a81a65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:46.918969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 978/1937] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:13:46.919876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.925703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 960/1938] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:46.930879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481515df-48ed-485a-8499-cc890b7a6a07 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:46.934275 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70e166-050a-4b39-8191-4a008a81a65b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.937482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:46.938178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.938456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.938730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.939425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:46.941356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:46.947342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70e166-050a-4b39-8191-4a008a81a65b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:46.957032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:46.959506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:46.959807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:46.960792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:46.962103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:13:46.962570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:46.964110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:46.972225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 979/1939] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:46.981202 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.982058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 961/1940] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:13:46.986701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:46.997969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b235db3-8670-4f8d-971e-2fefeaa0809b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.057663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77d10-d659-4c84-afef-4d0a01b985df admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.063050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.064510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.064868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.065221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.066033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.067976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.073494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.074421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.074851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.075272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.075668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:47.076953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.079478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.096958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 980/1941] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:47.098888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.110470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fa9e9-51d4-4698-83fa-0c4bf56625d8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.115390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 962/1942] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:46 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:13:47.117279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.178359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.179825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.179956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.180239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.180973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.182587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.190214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41747165-6f11-4164-85c4-e2c22d07b8f0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.192529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 981/1943] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:13:47.196870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.196870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.196870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.196870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.197379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.197630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.199270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.207461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b5d8b-450e-497a-ad5a-f5c06e67a272 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.213729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.214484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.214772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.215071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.216333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.218014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.221646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 963/1944] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:47 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:47.226251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.232348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 982/1945] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:13:47.233285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.236920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4fe01-4a19-4ec0-9983-c2874215f6dc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.242236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.242894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.243177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.243454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.243551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0e3c9-fed7-4cf6-a4e7-bd5d65d768c7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.244203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.245800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.248122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130f19b-873b-42d4-91aa-d1b1d78c7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.249015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f19b-873b-42d4-91aa-d1b1d78c7f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.249302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f19b-873b-42d4-91aa-d1b1d78c7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.249582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130f19b-873b-42d4-91aa-d1b1d78c7f1b admin admin] PATH_INFO: `/v3/projects/e31ca7a7e5644d8081b36cd7391fa5ba/users/94be8de739184e37a56158f932633a44/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.255814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 964/1946] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:47.260220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.265232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f19b-873b-42d4-91aa-d1b1d78c7f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31ca7a7e5644d8081b36cd7391fa5ba, user_id=94be8de739184e37a56158f932633a44, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.267875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130f19b-873b-42d4-91aa-d1b1d78c7f1b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.269745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdb70f-736f-475a-aa09-0f6181aadd8d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.275267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.275957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.276268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.276545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.277262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.278831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.281298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 983/1947] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:47 2022] PUT /identity/v3/projects/e31ca7a7e5644d8081b36cd7391fa5ba/users/94be8de739184e37a56158f932633a44/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:47.292052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.292371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.292651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.294929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 965/1948] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:13:47.298814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.308536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff52e-a922-4799-a9ba-9a3b0959a296 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.313291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:47.318873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] MFA Rules not processed for user `94be8de739184e37a56158f932633a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:47.320459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:47.367314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f09ba4-5f67-40a0-b6aa-69eb97dcb38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.368225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09ba4-5f67-40a0-b6aa-69eb97dcb38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.368508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09ba4-5f67-40a0-b6aa-69eb97dcb38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.368781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f09ba4-5f67-40a0-b6aa-69eb97dcb38c admin admin] PATH_INFO: `/v3/projects/9868add8c6114cc2a3933d63b2e5652a/users/850e2609986546f68540aec652d1cd9f/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.384998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f09ba4-5f67-40a0-b6aa-69eb97dcb38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9868add8c6114cc2a3933d63b2e5652a, user_id=850e2609986546f68540aec652d1cd9f, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.387668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f09ba4-5f67-40a0-b6aa-69eb97dcb38c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.389181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 984/1949] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:47.401375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.402553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 966/1950] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:47 2022] PUT /identity/v3/projects/9868add8c6114cc2a3933d63b2e5652a/users/850e2609986546f68540aec652d1cd9f/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:13:47.406029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:47.407330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.407642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.407948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.425469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:47.426689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:47.453101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:47.474763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564bf49-1143-46a5-812e-c46e628b2ccd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.504710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 967/1951] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:13:47.517504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:47.520162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:47.530249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.530920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.531209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.531486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.612256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bbe1a-0f27-47be-9400-26077590d757 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:47.616766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad53449-55d7-43c8-bf03-67a1a9b0d41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:47.617430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad53449-55d7-43c8-bf03-67a1a9b0d41c service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:47.617709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad53449-55d7-43c8-bf03-67a1a9b0d41c service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:47.617978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad53449-55d7-43c8-bf03-67a1a9b0d41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:47.631151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad53449-55d7-43c8-bf03-67a1a9b0d41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.632713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad53449-55d7-43c8-bf03-67a1a9b0d41c service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.638334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:47.639796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:47.645760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 968/1952] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:13:47.650895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 985/1953] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:13:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:13:53.339518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117cdf5-f61f-4129-b078-de9c08a8fc51 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:53.340592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117cdf5-f61f-4129-b078-de9c08a8fc51 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:53.341532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117cdf5-f61f-4129-b078-de9c08a8fc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:53.391220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e117cdf5-f61f-4129-b078-de9c08a8fc51 None None] MFA Rules not processed for user `850e2609986546f68540aec652d1cd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:53.392509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e117cdf5-f61f-4129-b078-de9c08a8fc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:53.422488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:53.469930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 969/1954] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:13:53.474475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:53.486594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d985-7a37-4c46-a750-572bcd980a4f service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:53.491251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:53.491928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:53.492272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:53.492561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:53.493282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:53.495190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:53.522668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 986/1955] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:13:53 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:13:53.526479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117cdf5-f61f-4129-b078-de9c08a8fc51 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:53.537050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117cdf5-f61f-4129-b078-de9c08a8fc51 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:53.599670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:53.600375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:53.601210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:53.601922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:53.602273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:53.604207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:53.624804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 970/1956] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:13:53 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:13:53.628799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:53.639820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a430c2a-7146-4178-b259-2c16ae705300 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:53.644942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:53.645630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:53.645919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:53.646198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:53.646964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:53.649497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:53.662191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 987/1957] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:13:53.666918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:53.677321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926543eb-3f8c-43e0-b616-59976f63a73a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:53.683055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:53.683942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:53.684255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:53.684523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] PATH_INFO: `/v3/projects/2e75c3de720b47a0a974635594e41f39/users/0c303f98ab6a4103933ea8c9a98eecbb/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:53.701340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e75c3de720b47a0a974635594e41f39, user_id=0c303f98ab6a4103933ea8c9a98eecbb, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:53.704199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:53.719591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 971/1958] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:53 2022] PUT /identity/v3/projects/2e75c3de720b47a0a974635594e41f39/users/0c303f98ab6a4103933ea8c9a98eecbb/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:53.723662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:53.735056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6682eaf-5ac2-4b78-a87d-37c45d2d5388 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:53.805734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:53.806813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:53.807280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:53.808338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:53.809706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:53.812349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:53.825038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 988/1959] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:13:53.829183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:53.840269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7dfee6-847a-4bf4-a528-146cce6b6282 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:53.845009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f4e154-64da-4758-8942-81ade30e4baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:53.845902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4e154-64da-4758-8942-81ade30e4baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:53.846187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4e154-64da-4758-8942-81ade30e4baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:53.846464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f4e154-64da-4758-8942-81ade30e4baa admin admin] PATH_INFO: `/v3/projects/2e75c3de720b47a0a974635594e41f39/users/0c303f98ab6a4103933ea8c9a98eecbb/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:53.848520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4e154-64da-4758-8942-81ade30e4baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e75c3de720b47a0a974635594e41f39, user_id=0c303f98ab6a4103933ea8c9a98eecbb, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:53.851424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f4e154-64da-4758-8942-81ade30e4baa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:53.867480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 972/1960] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:13:53 2022] PUT /identity/v3/projects/2e75c3de720b47a0a974635594e41f39/users/0c303f98ab6a4103933ea8c9a98eecbb/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:59.300933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:13:59.316136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f967c-842d-48c1-b544-f140a46b923f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:13:59.343595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:13:59.435963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:13:59.437190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:59.437637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:59.438089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] PATH_INFO: `/v3/users/94be8de739184e37a56158f932633a44` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:59.439911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=94be8de739184e37a56158f932633a44)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:13:59.442570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:13:59.554213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94be8de739184e37a56158f932633a44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:59.556396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94be8de739184e37a56158f932633a44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:59.558475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94be8de739184e37a56158f932633a44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:59.590037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94be8de739184e37a56158f932633a44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:59.606123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94be8de739184e37a56158f932633a44'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:13:59.632536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 989/1961] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:13:59 2022] DELETE /identity/v3/users/94be8de739184e37a56158f932633a44 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:13:59.638494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:13:59.639031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:13:59.639314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:13:59.721176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:13:59.726478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:13:59.966570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 973/1962] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:00.024749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:00.026243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:00.157310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8edccb-a24a-476a-9594-3a818a2a0e2c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:00.162517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccb862-f357-4923-ba06-29c2839eab5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:00.164096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccb862-f357-4923-ba06-29c2839eab5f service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:00.164418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccb862-f357-4923-ba06-29c2839eab5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:00.164764 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccb862-f357-4923-ba06-29c2839eab5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:00.177663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccb862-f357-4923-ba06-29c2839eab5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:00.180254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccb862-f357-4923-ba06-29c2839eab5f service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:00.209063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 990/1963] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:00.826201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:00.827643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:00.855832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce7b2a-0c34-4bcd-bb01-a0e600c5ddfa None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:00.871461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:00.872379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:00.872669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:00.872949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] PATH_INFO: `/v3/projects/e31ca7a7e5644d8081b36cd7391fa5ba` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:00.874877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31ca7a7e5644d8081b36cd7391fa5ba)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:00.887188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:00.914496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:00.994728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31ca7a7e5644d8081b36cd7391fa5ba', 'request_id': 'req-e0013a33-b135-4ecc-8aa6-c701d87a8342'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:01.045697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31ca7a7e5644d8081b36cd7391fa5ba', 'request_id': 'req-e0013a33-b135-4ecc-8aa6-c701d87a8342'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:01.079164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31ca7a7e5644d8081b36cd7391fa5ba', 'request_id': 'req-e0013a33-b135-4ecc-8aa6-c701d87a8342'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:01.113826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] The token cache is being invalidate because project e31ca7a7e5644d8081b36cd7391fa5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:01.114974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:01.116993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e0013a33-b135-4ecc-8aa6-c701d87a8342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:01.136316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 974/1964] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:00 2022] DELETE /identity/v3/projects/e31ca7a7e5644d8081b36cd7391fa5ba => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:01.140909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe15ed-acb9-4b42-a7d4-f1c9592dd134 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:01.141878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe15ed-acb9-4b42-a7d4-f1c9592dd134 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:01.142364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe15ed-acb9-4b42-a7d4-f1c9592dd134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:01.174975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a9fe15ed-acb9-4b42-a7d4-f1c9592dd134 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:01.190249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a9fe15ed-acb9-4b42-a7d4-f1c9592dd134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:01.302036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:01.375322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 991/1965] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:01.384545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad401bb1-df5f-42e1-81bc-2b8496705568 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:01.385015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad401bb1-df5f-42e1-81bc-2b8496705568 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:01.385153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad401bb1-df5f-42e1-81bc-2b8496705568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:01.435455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ad401bb1-df5f-42e1-81bc-2b8496705568 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:01.452060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ad401bb1-df5f-42e1-81bc-2b8496705568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:01.477520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 975/1966] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:01.478475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe15ed-acb9-4b42-a7d4-f1c9592dd134 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:01.498189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe15ed-acb9-4b42-a7d4-f1c9592dd134 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:01.509794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:01.511229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:01.511695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:01.512124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:01.513193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:01.513930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:01.517564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:01.549822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 992/1967] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:01.554744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad401bb1-df5f-42e1-81bc-2b8496705568 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:01.581096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad401bb1-df5f-42e1-81bc-2b8496705568 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:01.605090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:01.606035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:01.606531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:01.607040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:01.607953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:01.610637 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:01.691172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:01.697985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 976/1968] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:01 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:01.707934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35655b-ed42-4c50-8c4b-fdb3fae6e3fe admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:01.826824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:01.827557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:01.827950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:01.828430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:01.829592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:01.833711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:01.895319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:01.907646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 993/1969] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:01 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:01.910384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792fe0e-a4fa-45b1-851b-c87ac229a547 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:01.918699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:01.920432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:01.920628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:01.921139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:01.922293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:01.924320 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:01.944913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:01.953841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 977/1970] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:01.958654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30f042-e0e2-4094-8f6c-8d64f4689faa admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:01.967454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cd5d2-5e7d-47ed-9319-e34af75969d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:01.968431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cd5d2-5e7d-47ed-9319-e34af75969d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:01.968862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cd5d2-5e7d-47ed-9319-e34af75969d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:01.969283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cd5d2-5e7d-47ed-9319-e34af75969d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:01.970191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cd5d2-5e7d-47ed-9319-e34af75969d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:01.971967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cd5d2-5e7d-47ed-9319-e34af75969d2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:01.992841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 994/1971] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:01.994359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:02.041290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e58c1-4447-4c55-8f88-7c95bb0e6341 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:02.048573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:02.049487 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:02.049765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:02.050037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] PATH_INFO: `/v3/projects/9f198fdf8b50413c9bbe6f90cd62d740/users/095df840d019443e81981af5e8761e24/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:02.086323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f198fdf8b50413c9bbe6f90cd62d740, user_id=095df840d019443e81981af5e8761e24, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:02.089206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:02.115996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 978/1972] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:01 2022] PUT /identity/v3/projects/9f198fdf8b50413c9bbe6f90cd62d740/users/095df840d019443e81981af5e8761e24/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:02.119803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8591b70-659e-4721-9d0c-b28045661e8c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:02.120098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8591b70-659e-4721-9d0c-b28045661e8c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:02.120424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8591b70-659e-4721-9d0c-b28045661e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:02.164026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c8591b70-659e-4721-9d0c-b28045661e8c None None] MFA Rules not processed for user `095df840d019443e81981af5e8761e24`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:02.166773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c8591b70-659e-4721-9d0c-b28045661e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:02.266635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 995/1973] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:02.284088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:02.285937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:02.372869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744de562-3a18-4efc-aecf-203e5d509323 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:02.377979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:02.378802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:02.379164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:02.379459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:02.396396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:02.399359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:02.417971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 979/1974] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:02.572418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c28d8-163c-4248-894e-b15147eb95e7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:02.572941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c28d8-163c-4248-894e-b15147eb95e7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:02.573464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c28d8-163c-4248-894e-b15147eb95e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:02.611035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d51c28d8-163c-4248-894e-b15147eb95e7 None None] MFA Rules not processed for user `0c303f98ab6a4103933ea8c9a98eecbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:02.612315 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d51c28d8-163c-4248-894e-b15147eb95e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:02.656495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:02.740676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 996/1975] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:02.751665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:02.753346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:02.879253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:02.952721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a07d60-ec60-4c9f-922e-2eb9e2434042 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:02.971715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:02.972819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:02.973221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:02.973607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:02.978894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:03.102763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:03.106001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:03.121234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 980/1976] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:04.320134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752554-32c7-4ee1-acfd-ba708b4ac675 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:04.320134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752554-32c7-4ee1-acfd-ba708b4ac675 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:04.321389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91752554-32c7-4ee1-acfd-ba708b4ac675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:04.346647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-91752554-32c7-4ee1-acfd-ba708b4ac675 None None] MFA Rules not processed for user `850e2609986546f68540aec652d1cd9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:04.348195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-91752554-32c7-4ee1-acfd-ba708b4ac675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:04.357774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 997/1977] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:07.511929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:07.609088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b188ffa-7572-4ba3-a528-2475829c9519 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:07.615706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:07.618083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:07.618678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:07.619167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] PATH_INFO: `/v3/users/095df840d019443e81981af5e8761e24` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:07.620892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095df840d019443e81981af5e8761e24)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:07.624338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:07.686293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095df840d019443e81981af5e8761e24'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:07.687988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095df840d019443e81981af5e8761e24'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:07.688868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095df840d019443e81981af5e8761e24'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:07.716854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095df840d019443e81981af5e8761e24'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:07.731281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095df840d019443e81981af5e8761e24'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:07.742571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:07.766010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 981/1978] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:07 2022] DELETE /identity/v3/users/095df840d019443e81981af5e8761e24 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:07.766585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:07.767688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:07.767688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:07.810986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:07.812723 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:07.982867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 998/1979] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:08.003945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:08.005418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:08.152054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197f3ca-bb24-4726-a2d6-01a0917524c7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:08.158274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871152b6-8407-458e-9d34-0eec7fffe1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:08.159166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871152b6-8407-458e-9d34-0eec7fffe1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:08.159451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871152b6-8407-458e-9d34-0eec7fffe1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:08.159732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871152b6-8407-458e-9d34-0eec7fffe1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:08.172580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871152b6-8407-458e-9d34-0eec7fffe1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:08.174710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871152b6-8407-458e-9d34-0eec7fffe1d0 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:08.213737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 982/1980] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:08.586479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:08.588696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:08.610870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b921b-0fcf-46eb-acca-81289086d5ad None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:08.621605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:08.623356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:08.623828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:08.624440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] PATH_INFO: `/v3/users/f35147f834f545619889c6f6ef65f809` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:08.626380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35147f834f545619889c6f6ef65f809)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:08.629073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:08.701266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35147f834f545619889c6f6ef65f809'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:08.702806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35147f834f545619889c6f6ef65f809'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:08.703553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35147f834f545619889c6f6ef65f809'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:08.721602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35147f834f545619889c6f6ef65f809'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:08.731876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35147f834f545619889c6f6ef65f809'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:08.758087 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 999/1981] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:08 2022] DELETE /identity/v3/users/f35147f834f545619889c6f6ef65f809 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:08.763560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:08.765775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:08.766241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:08.796270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:08.797996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:08.883765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 983/1982] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:08.925043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:08.926759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:08.964950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:09.021680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080cc149-79de-4590-924c-5373ded0b444 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:09.027432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfedb5-ebb5-4c25-a2b0-0c6cd973c80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:09.028359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfedb5-ebb5-4c25-a2b0-0c6cd973c80c service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:09.029242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfedb5-ebb5-4c25-a2b0-0c6cd973c80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:09.029726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfedb5-ebb5-4c25-a2b0-0c6cd973c80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:09.063456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfedb5-ebb5-4c25-a2b0-0c6cd973c80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:09.065434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfedb5-ebb5-4c25-a2b0-0c6cd973c80c service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:09.082024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1000/1983] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:09.126348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:09.127949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:09.199840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605947c9-8989-4405-a2bf-216ff6e5277d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:09.209245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:09.211385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:09.211742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:09.212131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] PATH_INFO: `/v3/projects/9f198fdf8b50413c9bbe6f90cd62d740` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:09.215915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f198fdf8b50413c9bbe6f90cd62d740)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:09.222573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:09.312309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f198fdf8b50413c9bbe6f90cd62d740', 'request_id': 'req-3ca528b2-8263-4906-8f18-8458a4d45311'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:09.324926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f198fdf8b50413c9bbe6f90cd62d740', 'request_id': 'req-3ca528b2-8263-4906-8f18-8458a4d45311'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:09.346402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f198fdf8b50413c9bbe6f90cd62d740', 'request_id': 'req-3ca528b2-8263-4906-8f18-8458a4d45311'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:09.363406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] The token cache is being invalidate because project 9f198fdf8b50413c9bbe6f90cd62d740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:09.363696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:09.364456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3ca528b2-8263-4906-8f18-8458a4d45311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:09.368439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 984/1984] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:09 2022] DELETE /identity/v3/projects/9f198fdf8b50413c9bbe6f90cd62d740 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:09.373058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38cd4-b96b-4770-abf1-5b965833dd7b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:09.373574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38cd4-b96b-4770-abf1-5b965833dd7b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:09.374040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad38cd4-b96b-4770-abf1-5b965833dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:09.402263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-aad38cd4-b96b-4770-abf1-5b965833dd7b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:09.407368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-aad38cd4-b96b-4770-abf1-5b965833dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:09.586374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1001/1985] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:09.606656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cf48-1110-4e0f-8e88-3f5a33dd7784 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:09.607046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cf48-1110-4e0f-8e88-3f5a33dd7784 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:09.607498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267cf48-1110-4e0f-8e88-3f5a33dd7784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:09.667104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4267cf48-1110-4e0f-8e88-3f5a33dd7784 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:09.676452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4267cf48-1110-4e0f-8e88-3f5a33dd7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:09.734719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 985/1986] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:09.739921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad38cd4-b96b-4770-abf1-5b965833dd7b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:09.773146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad38cd4-b96b-4770-abf1-5b965833dd7b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:09.793649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5920-5286-42ee-a518-724234439495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:09.795171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5920-5286-42ee-a518-724234439495 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:09.795559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5920-5286-42ee-a518-724234439495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:09.795941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5920-5286-42ee-a518-724234439495 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:09.797213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5920-5286-42ee-a518-724234439495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:09.797985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5920-5286-42ee-a518-724234439495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:09.806153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5920-5286-42ee-a518-724234439495 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:09.838509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1002/1987] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:09.841590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267cf48-1110-4e0f-8e88-3f5a33dd7784 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:09.853944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267cf48-1110-4e0f-8e88-3f5a33dd7784 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:09.879536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:09.885396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:09.885895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:09.886359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:09.887094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:09.891733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:09.929169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:09.986773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 986/1988] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:09 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:09.987631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5920-5286-42ee-a518-724234439495 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:10.007725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5920-5286-42ee-a518-724234439495 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:10.152279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:10.153965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.154266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.154547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.156124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:10.161016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:10.225713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:10.239292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:10.275083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1003/1989] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:09 2022] POST /identity/v3/users => generated 283 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:10.280909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:10.298591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71454-4779-4fd1-8ffe-323e3ca8713d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:10.308883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85612c2-eb63-4861-8dd6-0fdae6bafe58 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:10.317095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:10.321635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.323656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.325208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] PATH_INFO: `/v3/projects/296045c2a5f841d084bd9d3ff5d7763b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.328549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296045c2a5f841d084bd9d3ff5d7763b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:10.329426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:10.330479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.333046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.333436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.334788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:10.335203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:10.339578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:10.361140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1004/1990] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:10.365265 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:10.378713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23eba0-d8ca-4aa3-90b1-f661bf619d23 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:10.386747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:10.387955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.388479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.389636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.390546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:10.392525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:10.423538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1005/1991] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:10.427156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:10.445447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92957a39-c08c-4205-9787-8d4a694764c0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:10.458555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43827f48-0f6c-42d2-957d-a0e892fea383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:10.460452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827f48-0f6c-42d2-957d-a0e892fea383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.461158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827f48-0f6c-42d2-957d-a0e892fea383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.461539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43827f48-0f6c-42d2-957d-a0e892fea383 admin admin] PATH_INFO: `/v3/projects/a5997fe314aa4ab4a13b8dfe60f82143/users/6309d4b397f948b0b7d2c92ae65b76eb/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.481079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296045c2a5f841d084bd9d3ff5d7763b', 'request_id': 'req-2abadef9-19fe-47ca-b15f-556b7235c213'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:10.487464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827f48-0f6c-42d2-957d-a0e892fea383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5997fe314aa4ab4a13b8dfe60f82143, user_id=6309d4b397f948b0b7d2c92ae65b76eb, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:10.492024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43827f48-0f6c-42d2-957d-a0e892fea383 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:10.496389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296045c2a5f841d084bd9d3ff5d7763b', 'request_id': 'req-2abadef9-19fe-47ca-b15f-556b7235c213'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:10.496605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:10.518316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1006/1992] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:10 2022] PUT /identity/v3/projects/a5997fe314aa4ab4a13b8dfe60f82143/users/6309d4b397f948b0b7d2c92ae65b76eb/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:10.530208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296045c2a5f841d084bd9d3ff5d7763b', 'request_id': 'req-2abadef9-19fe-47ca-b15f-556b7235c213'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:10.531126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.531533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.531877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.555915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] The token cache is being invalidate because project 296045c2a5f841d084bd9d3ff5d7763b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:10.556109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:10.556906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:10.565851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 987/1993] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:10 2022] DELETE /identity/v3/projects/296045c2a5f841d084bd9d3ff5d7763b => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:10.570877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:10.572384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:10.599940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] MFA Rules not processed for user `6309d4b397f948b0b7d2c92ae65b76eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:10.601510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:10.715787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1007/1994] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:10.741844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:10.754556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:10.763200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abadef9-19fe-47ca-b15f-556b7235c213 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:10.866761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c0e31-ae36-431e-953e-6a328d8e2223 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:10.879831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:10.880539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.880839 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.881107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.885927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:10.887536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:10.888082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:10.888588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] PATH_INFO: `/v3/users/e4112c1256c24c879902c47eaf21ecb0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:10.890108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4112c1256c24c879902c47eaf21ecb0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:10.892864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:10.900207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:10.901637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:10.924848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1008/1995] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:14:10.957706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:10.988677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4112c1256c24c879902c47eaf21ecb0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:10.989462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4112c1256c24c879902c47eaf21ecb0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:10.990096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4112c1256c24c879902c47eaf21ecb0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.005850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4112c1256c24c879902c47eaf21ecb0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.019208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ec04854b-9af7-4477-9df6-7d94e2959e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4112c1256c24c879902c47eaf21ecb0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.039733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 988/1996] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:10 2022] DELETE /identity/v3/users/e4112c1256c24c879902c47eaf21ecb0 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:11.549369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:11.583262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d421359-21d8-46dd-8404-cac42fc2070a service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:11.671151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:11.672035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:11.672349 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:11.672623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] PATH_INFO: `/v3/projects/58076bf974f24b3ab6ec6754c85b6f53` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:11.673884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58076bf974f24b3ab6ec6754c85b6f53)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:11.675775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:11.720947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:11.744331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58076bf974f24b3ab6ec6754c85b6f53', 'request_id': 'req-9ef2d1ed-fbe9-4add-863d-0715540725f8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.750976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58076bf974f24b3ab6ec6754c85b6f53', 'request_id': 'req-9ef2d1ed-fbe9-4add-863d-0715540725f8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.759867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58076bf974f24b3ab6ec6754c85b6f53', 'request_id': 'req-9ef2d1ed-fbe9-4add-863d-0715540725f8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.771878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] The token cache is being invalidate because project 58076bf974f24b3ab6ec6754c85b6f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:11.773745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.774600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9ef2d1ed-fbe9-4add-863d-0715540725f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:11.777585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1009/1997] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:11 2022] DELETE /identity/v3/projects/58076bf974f24b3ab6ec6754c85b6f53 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:11.782976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:11.783979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:11.784331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:11.808359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:11.809706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:11.907944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6a12f-7de8-45f9-a373-afdaaa513aeb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:11.908269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6a12f-7de8-45f9-a373-afdaaa513aeb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:11.908435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 989/1998] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:11.908948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6a12f-7de8-45f9-a373-afdaaa513aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:11.937269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:11.939052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:11.955502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04807566-2e00-4cb2-8daf-02f4d669eb6c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:11.955635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3aa6a12f-7de8-45f9-a373-afdaaa513aeb None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:11.956751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3aa6a12f-7de8-45f9-a373-afdaaa513aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:11.961572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:11.962728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:11.963151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:11.963666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] PATH_INFO: `/v3/users/d505423767a149b197ef117cec54b54d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:11.965339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d505423767a149b197ef117cec54b54d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:11.965918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1010/1999] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:11.968123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:11.973146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6a12f-7de8-45f9-a373-afdaaa513aeb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:11.995154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6a12f-7de8-45f9-a373-afdaaa513aeb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.000624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.001304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.001681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.001886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.002753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:12.003167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.004807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.018677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1011/2000] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:12.027388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd505423767a149b197ef117cec54b54d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.028073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd505423767a149b197ef117cec54b54d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.028740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd505423767a149b197ef117cec54b54d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.030810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.032574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:12.041140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd505423767a149b197ef117cec54b54d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.045155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3433f5-d61b-41e9-af69-21c12298aed4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.048992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd505423767a149b197ef117cec54b54d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.050514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.051206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.051487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.051760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.052888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.055067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.064292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 990/2001] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:11 2022] DELETE /identity/v3/users/d505423767a149b197ef117cec54b54d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:12.096093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1012/2002] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:12 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:12.100408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.119796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:12.168843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe97de-7e61-4009-a75e-e297c87e37a6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.233442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.234326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.234681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.234966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.235943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.237959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.253129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.255083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:12.266931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 991/2003] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:12 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:12.271404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.274809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38416e0a-5947-4705-998e-e993ef5726cd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.280494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.281384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.281756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.281944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] PATH_INFO: `/v3/projects/57c997889f0248deb60b4af3bd260b13` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.283172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c997889f0248deb60b4af3bd260b13)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.284060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf9239-3690-46d5-8b6d-ae2127258d33 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.285136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.289655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.290332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.290617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.290896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.291651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.293905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.305613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 992/2004] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:12.309519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.321199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0f3e9-dc2d-4626-a351-6026ed4d6c08 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.326305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.326974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.327249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.327524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.328279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.329863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.337066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c997889f0248deb60b4af3bd260b13', 'request_id': 'req-e847ee44-a6f2-4566-b965-9d010674a0cc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.342542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 993/2005] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:12.344293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c997889f0248deb60b4af3bd260b13', 'request_id': 'req-e847ee44-a6f2-4566-b965-9d010674a0cc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.346356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.352310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c997889f0248deb60b4af3bd260b13', 'request_id': 'req-e847ee44-a6f2-4566-b965-9d010674a0cc'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.356891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9ce11-02af-41b8-b429-1ec6934f21da admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.363988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] The token cache is being invalidate because project 57c997889f0248deb60b4af3bd260b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:12.364418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.365177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.367289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1013/2006] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:12 2022] DELETE /identity/v3/projects/57c997889f0248deb60b4af3bd260b13 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:12.371368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.372546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:12.427260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48c8d-a541-44fe-b4e9-50570b86dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.428156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48c8d-a541-44fe-b4e9-50570b86dfb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.428504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48c8d-a541-44fe-b4e9-50570b86dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.428792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48c8d-a541-44fe-b4e9-50570b86dfb5 admin admin] PATH_INFO: `/v3/projects/9e435f9bd7944557a7d41f53e68f79b8/users/80cc2dc43aff49daa47b0cbce7021d99/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.451924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db48c8d-a541-44fe-b4e9-50570b86dfb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e435f9bd7944557a7d41f53e68f79b8, user_id=80cc2dc43aff49daa47b0cbce7021d99, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.454706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db48c8d-a541-44fe-b4e9-50570b86dfb5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.459461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e847ee44-a6f2-4566-b965-9d010674a0cc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.465993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.467008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.467362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.467711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] PATH_INFO: `/v3/users/75ebf52917f646e9bbd6b25a685a589f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.469129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ebf52917f646e9bbd6b25a685a589f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.471216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.471922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 994/2007] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:12 2022] PUT /identity/v3/projects/9e435f9bd7944557a7d41f53e68f79b8/users/80cc2dc43aff49daa47b0cbce7021d99/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:12.483132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162a70-ec9a-45f1-9a2c-883a9ad7ce41 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.483428 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162a70-ec9a-45f1-9a2c-883a9ad7ce41 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.483578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:12.483693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42162a70-ec9a-45f1-9a2c-883a9ad7ce41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.517796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:12.521618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-42162a70-ec9a-45f1-9a2c-883a9ad7ce41 None None] MFA Rules not processed for user `80cc2dc43aff49daa47b0cbce7021d99`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:12.523862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-42162a70-ec9a-45f1-9a2c-883a9ad7ce41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:12.529307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ebf52917f646e9bbd6b25a685a589f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.530048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ebf52917f646e9bbd6b25a685a589f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.534643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ebf52917f646e9bbd6b25a685a589f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.552479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ebf52917f646e9bbd6b25a685a589f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.564363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ebf52917f646e9bbd6b25a685a589f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:12.579501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1014/2008] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:12 2022] DELETE /identity/v3/users/75ebf52917f646e9bbd6b25a685a589f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:12.623946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 995/2009] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:12.628388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.633588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:12.711805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc88f-bae4-46eb-b169-2a3bd0db2cfc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.720388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.721241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.721524 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.721792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.722509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.725111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.767145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1015/2010] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:12 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:12.768489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42162a70-ec9a-45f1-9a2c-883a9ad7ce41 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.816744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:12.818607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:12.874929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42162a70-ec9a-45f1-9a2c-883a9ad7ce41 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.908684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd447b-3cdf-402c-b9ce-a58d59c22d14 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:12.915379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.916897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.917193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.917469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] PATH_INFO: `/v3/projects/14b98956d6a147a89ee56c4d03a18be0` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.918767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b98956d6a147a89ee56c4d03a18be0)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.920940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.928115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:12.955180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:12.955871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:12.956163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:12.956616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:12.957356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:12.959579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:12.989215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 996/2011] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:12 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:12.992037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.009535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b98956d6a147a89ee56c4d03a18be0', 'request_id': 'req-b6a54f7c-1f6d-4be3-8f45-791e63346aed'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:13.009715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed00f7-be8a-4035-be48-bcbf334dc315 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.018907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b98956d6a147a89ee56c4d03a18be0', 'request_id': 'req-b6a54f7c-1f6d-4be3-8f45-791e63346aed'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:13.033536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b98956d6a147a89ee56c4d03a18be0', 'request_id': 'req-b6a54f7c-1f6d-4be3-8f45-791e63346aed'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:13.048829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] The token cache is being invalidate because project 14b98956d6a147a89ee56c4d03a18be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:13.049304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:13.050101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b6a54f7c-1f6d-4be3-8f45-791e63346aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:13.052047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1016/2012] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:12 2022] DELETE /identity/v3/projects/14b98956d6a147a89ee56c4d03a18be0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:13.058894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d95b-32a6-4427-948f-35fb498c816a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.059989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d95b-32a6-4427-948f-35fb498c816a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.060482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4d95b-32a6-4427-948f-35fb498c816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.092343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:13.099877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-09d4d95b-32a6-4427-948f-35fb498c816a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:13.101224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-09d4d95b-32a6-4427-948f-35fb498c816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:13.118322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.119145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.119499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.119847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.120758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.122451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.133936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 997/2013] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:13.138576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.140911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:13.156187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4234a-02ca-4513-b2ea-7033f4f0400e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.161006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.161900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.162177 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.162467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] PATH_INFO: `/v3/projects/9a126619ab1c4b39a982b6572d6b403f/users/26ddd911a7ae47d3b019a37b0ad568a7/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.169578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1017/2014] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:13.177429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b5fa-04ee-4d15-bf6e-99888d89119f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.177726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b5fa-04ee-4d15-bf6e-99888d89119f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.178001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655b5fa-04ee-4d15-bf6e-99888d89119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.182427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a126619ab1c4b39a982b6572d6b403f, user_id=26ddd911a7ae47d3b019a37b0ad568a7, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.186073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.200530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e655b5fa-04ee-4d15-bf6e-99888d89119f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:13.201890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e655b5fa-04ee-4d15-bf6e-99888d89119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:13.208071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 998/2015] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:13 2022] PUT /identity/v3/projects/9a126619ab1c4b39a982b6572d6b403f/users/26ddd911a7ae47d3b019a37b0ad568a7/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:13.212625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.274501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1018/2016] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:13.279158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b5fa-04ee-4d15-bf6e-99888d89119f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.291539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655b5fa-04ee-4d15-bf6e-99888d89119f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.297882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.298713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.299193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2898ea-2882-4957-afa7-b836dd17387a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.299383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.299702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.300542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:13.301065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.303134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.305890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.307054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.307337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.307825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.308714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.310349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.322067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1019/2017] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:13.323459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.325463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 999/2018] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:13.329488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.340133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f408-d491-4304-92fa-22298059d6ec admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.341693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a31e66-9fcf-4a32-8b2d-399d07bcfd80 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.345315 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.345987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.346271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.346552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.347087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1c4a5-3f35-4b1d-a3d5-08f6e357f06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.347250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.348113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1c4a5-3f35-4b1d-a3d5-08f6e357f06c admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.348493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1c4a5-3f35-4b1d-a3d5-08f6e357f06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.348841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1c4a5-3f35-4b1d-a3d5-08f6e357f06c admin admin] PATH_INFO: `/v3/projects/9a126619ab1c4b39a982b6572d6b403f/users/26ddd911a7ae47d3b019a37b0ad568a7/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.349207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.351838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1c4a5-3f35-4b1d-a3d5-08f6e357f06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a126619ab1c4b39a982b6572d6b403f, user_id=26ddd911a7ae47d3b019a37b0ad568a7, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.354830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1c4a5-3f35-4b1d-a3d5-08f6e357f06c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.367175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1000/2019] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:13 2022] PUT /identity/v3/projects/9a126619ab1c4b39a982b6572d6b403f/users/26ddd911a7ae47d3b019a37b0ad568a7/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:13.377881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322adf-5469-4e74-ac57-dfcd121be31a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.378334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322adf-5469-4e74-ac57-dfcd121be31a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.378757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76322adf-5469-4e74-ac57-dfcd121be31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.379939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:13.390227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1020/2020] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:13.394534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.417077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-76322adf-5469-4e74-ac57-dfcd121be31a None None] MFA Rules not processed for user `26ddd911a7ae47d3b019a37b0ad568a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:13.418319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-76322adf-5469-4e74-ac57-dfcd121be31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:13.471523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07a48c-649d-47b4-9635-76010348c132 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.477698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.478507 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.478662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.478942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.479641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.481856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.504905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1001/2021] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:13.510204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1021/2022] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:13.514406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322adf-5469-4e74-ac57-dfcd121be31a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.520622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.522926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:13.526353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76322adf-5469-4e74-ac57-dfcd121be31a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.531441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.532195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.532502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.532774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.533505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.535105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.546334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1002/2023] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:13.550467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.560788 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23151579-c229-4b96-b53d-12f642992986 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.565572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.566227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.566513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.566793 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.567513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.569776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.571913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:13.584486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1003/2024] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:13.586602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.586801 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea01f0-eb9d-4a0f-9c37-753ca5aa7a25 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.590550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd77fc-0bd3-40c2-89a6-b7fa6e906302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.591205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd77fc-0bd3-40c2-89a6-b7fa6e906302 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.591492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd77fc-0bd3-40c2-89a6-b7fa6e906302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.591771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd77fc-0bd3-40c2-89a6-b7fa6e906302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.602879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ab43a-fdd2-4564-be95-98107b88079e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.608239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.609140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.609381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd77fc-0bd3-40c2-89a6-b7fa6e906302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.609512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.609693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] PATH_INFO: `/v3/projects/c71f82a7d80643de9728796ca683ad01/users/03f8bb814b1b4d57837ec5c9625b5528/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.611093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd77fc-0bd3-40c2-89a6-b7fa6e906302 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.621727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1022/2025] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:14:13.628870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71f82a7d80643de9728796ca683ad01, user_id=03f8bb814b1b4d57837ec5c9625b5528, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.631583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.646863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1004/2026] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:13 2022] PUT /identity/v3/projects/c71f82a7d80643de9728796ca683ad01/users/03f8bb814b1b4d57837ec5c9625b5528/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:13.657587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaa53b-b80c-4304-83bc-559dff7e3db7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.657884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaa53b-b80c-4304-83bc-559dff7e3db7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.658183 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdaa53b-b80c-4304-83bc-559dff7e3db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.690645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7cdaa53b-b80c-4304-83bc-559dff7e3db7 None None] MFA Rules not processed for user `03f8bb814b1b4d57837ec5c9625b5528`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:13.691915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7cdaa53b-b80c-4304-83bc-559dff7e3db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:13.706698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.760607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1023/2027] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:13.765024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaa53b-b80c-4304-83bc-559dff7e3db7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.765856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6278b98-a4fc-4183-a020-6504786c270d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.769551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.770207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.770491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.770781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.772822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:13.792370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:13.831364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdaa53b-b80c-4304-83bc-559dff7e3db7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.833229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.835201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.836974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.837642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.837931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.838211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.838908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.840852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.845038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1005/2028] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:14:13.869806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1024/2029] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:13.873497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:13.884626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f469e05-1aa8-47e6-a53d-5633bbe08aea service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:13.952342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:13.953052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:13.953731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:13.953731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:13.954411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:13.956333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:13.985525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1006/2030] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:13 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:13.989523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:14.002988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14c45-71f2-4e2c-8e61-965ecc2cbc3b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:14.008735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:14.009408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:14.009693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:14.009971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:14.010702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:14.012395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:14.024583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1025/2031] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:14.028635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:14.041709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc772e-ccd7-43d9-bd05-6fc41bcab544 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:14.047122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:14.048018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:14.048410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:14.048690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] PATH_INFO: `/v3/projects/3b04b7f579124d59892bb59f68bb80e2/users/4053487f560744da890edf072825a29a/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:14.064167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b04b7f579124d59892bb59f68bb80e2, user_id=4053487f560744da890edf072825a29a, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:14.066812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:14.069065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:14.081118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1007/2032] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:14 2022] PUT /identity/v3/projects/3b04b7f579124d59892bb59f68bb80e2/users/4053487f560744da890edf072825a29a/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:14.085330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:14.097212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3d2b9-7713-442b-85cd-17c4512c076d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:14.164134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34afd7-d0e7-43b7-83af-0b1795d9d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:14.165982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34afd7-d0e7-43b7-83af-0b1795d9d7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:14.165982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34afd7-d0e7-43b7-83af-0b1795d9d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:14.165982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34afd7-d0e7-43b7-83af-0b1795d9d7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:14.166341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34afd7-d0e7-43b7-83af-0b1795d9d7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:14.168016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34afd7-d0e7-43b7-83af-0b1795d9d7b5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:14.180630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1026/2033] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:14.185038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:14.197102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff15e0d-3fa7-403d-9159-50a0cac64ac3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:14.202109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:14.202967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:14.203256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:14.203527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] PATH_INFO: `/v3/projects/3b04b7f579124d59892bb59f68bb80e2/users/4053487f560744da890edf072825a29a/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:14.205611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b04b7f579124d59892bb59f68bb80e2, user_id=4053487f560744da890edf072825a29a, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:14.208284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:14.220567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1008/2034] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:14 2022] PUT /identity/v3/projects/3b04b7f579124d59892bb59f68bb80e2/users/4053487f560744da890edf072825a29a/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:14.232778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507061a-81d9-4231-9697-561bc42e7d79 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:14.233066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507061a-81d9-4231-9697-561bc42e7d79 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:14.233398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507061a-81d9-4231-9697-561bc42e7d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:14.267158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3507061a-81d9-4231-9697-561bc42e7d79 None None] MFA Rules not processed for user `4053487f560744da890edf072825a29a`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:14.268483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3507061a-81d9-4231-9697-561bc42e7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:14.370777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1027/2035] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:14.386551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:14.388972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:14.453475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22982-e18c-46aa-8ee4-458f466b162a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:14.457161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea7f02-91b9-488c-8c21-31e830eacd8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:14.457813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7f02-91b9-488c-8c21-31e830eacd8f service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:14.458209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7f02-91b9-488c-8c21-31e830eacd8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:14.458495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7f02-91b9-488c-8c21-31e830eacd8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:14.519125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea7f02-91b9-488c-8c21-31e830eacd8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:14.520601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea7f02-91b9-488c-8c21-31e830eacd8f service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:14.529803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1009/2036] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:16.608061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507061a-81d9-4231-9697-561bc42e7d79 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:16.627232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:16.675771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507061a-81d9-4231-9697-561bc42e7d79 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:16.680739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:16.681625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:16.681908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:16.682184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] PATH_INFO: `/v3/users/80cc2dc43aff49daa47b0cbce7021d99` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:16.683394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] RBAC: Authorizing `identity:delete_user(user_id=80cc2dc43aff49daa47b0cbce7021d99)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:16.685370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:16.758963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80cc2dc43aff49daa47b0cbce7021d99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:16.759844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80cc2dc43aff49daa47b0cbce7021d99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:16.760712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80cc2dc43aff49daa47b0cbce7021d99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:16.774098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80cc2dc43aff49daa47b0cbce7021d99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:16.784199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80cc2dc43aff49daa47b0cbce7021d99'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:16.807997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1028/2037] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:16 2022] DELETE /identity/v3/users/80cc2dc43aff49daa47b0cbce7021d99 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:16.812478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:16.812905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:16.813139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:16.836331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:16.837678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:16.902124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1010/2038] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:16.911876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:16.913380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:16.977427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d815f26a-b350-4b3a-aa15-c199b0a326de admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:16.981292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001e718-0dac-4f98-96bf-1f02cd1f2ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:16.981951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e718-0dac-4f98-96bf-1f02cd1f2ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:16.982268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e718-0dac-4f98-96bf-1f02cd1f2ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:16.982667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001e718-0dac-4f98-96bf-1f02cd1f2ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:16.992980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001e718-0dac-4f98-96bf-1f02cd1f2ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:16.994407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001e718-0dac-4f98-96bf-1f02cd1f2ef8 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:17.004110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1029/2039] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:17.083727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:17.085959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:17.100022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7bfb96-b4e6-4401-8efd-7b085ca11bfe None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:17.107953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:17.109427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:17.109672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:17.110166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] PATH_INFO: `/v3/users/03f8bb814b1b4d57837ec5c9625b5528` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:17.111942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03f8bb814b1b4d57837ec5c9625b5528)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:17.114178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:17.176393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:17.196754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03f8bb814b1b4d57837ec5c9625b5528'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.197450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03f8bb814b1b4d57837ec5c9625b5528'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.198110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03f8bb814b1b4d57837ec5c9625b5528'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.212868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03f8bb814b1b4d57837ec5c9625b5528'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.221581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03f8bb814b1b4d57837ec5c9625b5528'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.238592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1011/2040] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:17 2022] DELETE /identity/v3/users/03f8bb814b1b4d57837ec5c9625b5528 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:17.243303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:17.243598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:17.243900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:17.262383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:17.263634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:17.318277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:17.332977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:17.334535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:17.363220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1030/2041] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:17.373008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:17.374733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:17.439827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69185aa9-1d11-4a85-9b17-88b7a8ff9005 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:17.444656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2f47c-7696-4f7c-9427-00cd87efd049 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:17.448956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:17.449688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:17.449920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:17.450197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:17.452365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:17.453334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:17.453552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:17.453826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] PATH_INFO: `/v3/projects/9e435f9bd7944557a7d41f53e68f79b8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:17.455174 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e435f9bd7944557a7d41f53e68f79b8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:17.457282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:17.462798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:17.464278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:17.485695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1031/2042] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:14:17.536359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e435f9bd7944557a7d41f53e68f79b8', 'request_id': 'req-97bb62e8-0a69-46b7-8703-7037139e752b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.545250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e435f9bd7944557a7d41f53e68f79b8', 'request_id': 'req-97bb62e8-0a69-46b7-8703-7037139e752b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.557029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e435f9bd7944557a7d41f53e68f79b8', 'request_id': 'req-97bb62e8-0a69-46b7-8703-7037139e752b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.575392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] The token cache is being invalidate because project 9e435f9bd7944557a7d41f53e68f79b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:17.575687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.577517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.582042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1012/2043] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:17 2022] DELETE /identity/v3/projects/9e435f9bd7944557a7d41f53e68f79b8 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:17.583204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:17.600625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46305b-ea5c-46b0-a070-c31fa27ae20f service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:17.697440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:17.698410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:17.698675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:17.699585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] PATH_INFO: `/v3/users/26ddd911a7ae47d3b019a37b0ad568a7` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:17.700551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ddd911a7ae47d3b019a37b0ad568a7)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:17.702855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:17.765792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ddd911a7ae47d3b019a37b0ad568a7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.766403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ddd911a7ae47d3b019a37b0ad568a7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.767487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ddd911a7ae47d3b019a37b0ad568a7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.784713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ddd911a7ae47d3b019a37b0ad568a7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.796326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ddd911a7ae47d3b019a37b0ad568a7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:17.811939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1032/2044] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:17 2022] DELETE /identity/v3/users/26ddd911a7ae47d3b019a37b0ad568a7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:17.870659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:17.873388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:17.891099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb62e8-0a69-46b7-8703-7037139e752b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:17.953359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:18.001782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.003381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.003764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.004786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] PATH_INFO: `/v3/projects/c71f82a7d80643de9728796ca683ad01` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.007105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71f82a7d80643de9728796ca683ad01)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.010328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.108763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71f82a7d80643de9728796ca683ad01', 'request_id': 'req-f67c34c1-176a-40e2-b02b-db66f1868b0a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.119626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71f82a7d80643de9728796ca683ad01', 'request_id': 'req-f67c34c1-176a-40e2-b02b-db66f1868b0a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.136905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71f82a7d80643de9728796ca683ad01', 'request_id': 'req-f67c34c1-176a-40e2-b02b-db66f1868b0a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.153039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] The token cache is being invalidate because project c71f82a7d80643de9728796ca683ad01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:18.153247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.153981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.156276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1013/2045] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:17 2022] DELETE /identity/v3/projects/c71f82a7d80643de9728796ca683ad01 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:18.160671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.162161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.171475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:18.178395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbf83c-609a-4715-ae9e-2cf18eaa9c92 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:18.230163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.232101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.295715 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.296692 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.297025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.297337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] PATH_INFO: `/v3/users/4053487f560744da890edf072825a29a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.298543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4053487f560744da890edf072825a29a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.300518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.368263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c34c1-176a-40e2-b02b-db66f1868b0a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:18.374723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.377020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4053487f560744da890edf072825a29a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.377602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.377725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4053487f560744da890edf072825a29a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.378238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.378914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4053487f560744da890edf072825a29a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.380017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] PATH_INFO: `/v3/projects/9a126619ab1c4b39a982b6572d6b403f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.382835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a126619ab1c4b39a982b6572d6b403f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.387024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.394239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4053487f560744da890edf072825a29a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.403112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a9cfb10b-f634-48fa-892a-2b59955194c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4053487f560744da890edf072825a29a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.419616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1033/2046] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:18 2022] DELETE /identity/v3/users/4053487f560744da890edf072825a29a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:18.447484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a126619ab1c4b39a982b6572d6b403f', 'request_id': 'req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.454949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a126619ab1c4b39a982b6572d6b403f', 'request_id': 'req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.464020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a126619ab1c4b39a982b6572d6b403f', 'request_id': 'req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.470707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:18.477507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] The token cache is being invalidate because project 9a126619ab1c4b39a982b6572d6b403f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:18.478097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.478626 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6ddc1c7c-2a5f-435b-9d63-106856ab4dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.484279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1014/2047] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:18 2022] DELETE /identity/v3/projects/9a126619ab1c4b39a982b6572d6b403f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:18.487152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87c399-abac-462d-8e15-7b6a99313a18 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.487452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87c399-abac-462d-8e15-7b6a99313a18 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.487773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87c399-abac-462d-8e15-7b6a99313a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.513150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5c87c399-abac-462d-8e15-7b6a99313a18 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:18.514465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5c87c399-abac-462d-8e15-7b6a99313a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.610781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1034/2048] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:18.620746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7c6b3-bb80-4854-9d38-7bce7349fc25 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.621314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7c6b3-bb80-4854-9d38-7bce7349fc25 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.621747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7c6b3-bb80-4854-9d38-7bce7349fc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.645100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9dd7c6b3-bb80-4854-9d38-7bce7349fc25 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:18.646442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9dd7c6b3-bb80-4854-9d38-7bce7349fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.674768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1015/2049] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:18.679953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87c399-abac-462d-8e15-7b6a99313a18 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.693156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87c399-abac-462d-8e15-7b6a99313a18 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:18.698513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.699296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.699510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.700281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.700542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:18.701210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.703298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.724378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1035/2050] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:18.728725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7c6b3-bb80-4854-9d38-7bce7349fc25 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.739429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd7c6b3-bb80-4854-9d38-7bce7349fc25 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:18.741730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.743479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.745101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.746065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.746400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.746778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.747376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.749318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.759989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959440de-284d-4a2a-b1e8-99d2e7669fab admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:18.769895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.770939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.771083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.771471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] PATH_INFO: `/v3/projects/3b04b7f579124d59892bb59f68bb80e2` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.773004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b04b7f579124d59892bb59f68bb80e2)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.774960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.778458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:18.781504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1016/2051] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:18 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:18.785611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.828757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b04b7f579124d59892bb59f68bb80e2', 'request_id': 'req-81543355-fc8c-4a3a-b738-3467b512922d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.836770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b04b7f579124d59892bb59f68bb80e2', 'request_id': 'req-81543355-fc8c-4a3a-b738-3467b512922d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.844673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b04b7f579124d59892bb59f68bb80e2', 'request_id': 'req-81543355-fc8c-4a3a-b738-3467b512922d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.851674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f002e2-f16e-4faa-a854-990f768ae6d9 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:18.857070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] The token cache is being invalidate because project 3b04b7f579124d59892bb59f68bb80e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:18.857577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.858348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-81543355-fc8c-4a3a-b738-3467b512922d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:18.860215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1036/2052] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:18 2022] DELETE /identity/v3/projects/3b04b7f579124d59892bb59f68bb80e2 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:18.866263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236b48-7e21-4ea9-bf36-ebbcaf3a2fa8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.866263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236b48-7e21-4ea9-bf36-ebbcaf3a2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.866520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b236b48-7e21-4ea9-bf36-ebbcaf3a2fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.886007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1b236b48-7e21-4ea9-bf36-ebbcaf3a2fa8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:18.887236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1b236b48-7e21-4ea9-bf36-ebbcaf3a2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.922920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.923597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.923883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.924161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.924880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.926801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.947731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1017/2053] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:18 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:18.949225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1037/2054] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:18.951761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.953416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.957031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7f18d-7928-45aa-8237-d878912d853c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.957330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7f18d-7928-45aa-8237-d878912d853c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.957620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7f18d-7928-45aa-8237-d878912d853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.968663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9101707-4b9f-4089-af26-d084f1019744 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:18.974164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:18.974885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:18.975116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:18.975930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:18.977329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:18.977459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d5f7f18d-7928-45aa-8237-d878912d853c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:18.978675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d5f7f18d-7928-45aa-8237-d878912d853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:18.978945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:18.986926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1038/2055] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:18.992417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1018/2056] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:18.993368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:18.993585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7f18d-7928-45aa-8237-d878912d853c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.002843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7f18d-7928-45aa-8237-d878912d853c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.004362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ba7d4-071e-4ad3-bf1a-c44b81f050d6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.008670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.009326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.009594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.009702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.009879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.010241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.010530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.010633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:19.010830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.010975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.011556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.012583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.013161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.026198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1019/2057] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:19.027280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1039/2058] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:19.030586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.031329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.040674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec130969-ee9e-49de-8ec8-59e5fc2b02d8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.041313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8a40b-429f-45c1-bd79-3a128aa75603 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.045274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa17305-f70d-4632-93c1-2d29a04b37b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.045969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.046153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17305-f70d-4632-93c1-2d29a04b37b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.046438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17305-f70d-4632-93c1-2d29a04b37b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.046615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.046706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa17305-f70d-4632-93c1-2d29a04b37b3 admin admin] PATH_INFO: `/v3/projects/c58e5ea2f0954e539fd2033a91b9a7c6/users/f6763fe25ab34ffd8464005090f50283/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.047096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.047377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.048362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.050282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.062062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa17305-f70d-4632-93c1-2d29a04b37b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58e5ea2f0954e539fd2033a91b9a7c6, user_id=f6763fe25ab34ffd8464005090f50283, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.064954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa17305-f70d-4632-93c1-2d29a04b37b3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.082075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1040/2059] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:19.082228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1020/2060] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:19 2022] PUT /identity/v3/projects/c58e5ea2f0954e539fd2033a91b9a7c6/users/f6763fe25ab34ffd8464005090f50283/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:19.083059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.091964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4aa67-3ff0-4ef9-99e4-f0275c4e93ca None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.092298 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4aa67-3ff0-4ef9-99e4-f0275c4e93ca None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.092711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4aa67-3ff0-4ef9-99e4-f0275c4e93ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.120099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-aab4aa67-3ff0-4ef9-99e4-f0275c4e93ca None None] MFA Rules not processed for user `f6763fe25ab34ffd8464005090f50283`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:19.121361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aab4aa67-3ff0-4ef9-99e4-f0275c4e93ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:19.129587 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:19.137793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:19.150355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f05e1-057b-4b05-836b-49c6b88be72e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.158280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.159761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.160054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.160367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.161075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.163852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.197053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1021/2061] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:19.200825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1041/2062] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:19.202041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4aa67-3ff0-4ef9-99e4-f0275c4e93ca None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.202218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.212660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734ee39-36e4-459a-a4a4-30d6aa6efdfb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.214599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4aa67-3ff0-4ef9-99e4-f0275c4e93ca None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.218160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.219257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.219461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.219897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.220150 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.220393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.220802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.221148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.221255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.222366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.223258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.224201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.246130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1022/2063] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:19.251355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.255864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1042/2064] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:19.260538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.262147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0444da-71f9-4156-9b63-c2743599ce1c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.353879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.353879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.353879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.353879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.355705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.356417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.357725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea4047-9711-41d5-8e11-0aac1533ebdb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.363199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.363911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.364319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.364497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.365214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.366914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1023/2065] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:19.367200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.371000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.383086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f9654-3279-4075-8bf4-b5b636ae9b97 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.391102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d207d6c4-7dfd-4cf0-8964-2133fd9c1f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.392046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d6c4-7dfd-4cf0-8964-2133fd9c1f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.392481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d6c4-7dfd-4cf0-8964-2133fd9c1f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.392681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d207d6c4-7dfd-4cf0-8964-2133fd9c1f0d admin admin] PATH_INFO: `/v3/projects/c35bc14ede4043eabee0ff92c1284be7/users/0d184898c0b644dc98f549e056c1baf0/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.394525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1043/2066] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/users => generated 306 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:19.399227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.410584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27364bdb-9ee1-459e-9c33-27ee960f04c5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.414569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d6c4-7dfd-4cf0-8964-2133fd9c1f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35bc14ede4043eabee0ff92c1284be7, user_id=0d184898c0b644dc98f549e056c1baf0, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.417379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d207d6c4-7dfd-4cf0-8964-2133fd9c1f0d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.431612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.431612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.431612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.431612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.432058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.433986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.443802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1024/2067] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:19 2022] PUT /identity/v3/projects/c35bc14ede4043eabee0ff92c1284be7/users/0d184898c0b644dc98f549e056c1baf0/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:19.446365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.446696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.446997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.448366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1044/2068] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:19.452403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.463520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1be9-0a71-4f4c-9074-c58852563015 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.489973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] MFA Rules not processed for user `0d184898c0b644dc98f549e056c1baf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:19.491430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:19.540284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.541727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.541727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.541949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] PATH_INFO: `/v3/projects/f3c2100cf29b483ca2b7ff9999d466f6/users/3f8fb42e7d12432eaadaccf8e1a9a4cf/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.565514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c2100cf29b483ca2b7ff9999d466f6, user_id=3f8fb42e7d12432eaadaccf8e1a9a4cf, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.568226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.573242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:19.581543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1025/2069] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:19.586875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1045/2070] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:19 2022] PUT /identity/v3/projects/f3c2100cf29b483ca2b7ff9999d466f6/users/3f8fb42e7d12432eaadaccf8e1a9a4cf/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:19.589175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.590679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.590808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:19.623100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:19.648471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004b44f-4bc8-41b9-8162-5dc69f87cba7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.665044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216697c-c6dc-4f0e-849a-438f80e2dbca admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.669818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.670494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.670778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.671053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.671781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.673486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.685254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1046/2071] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:19.689526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.698340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.698986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.699170 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c6e95-34e1-4173-859f-496adbcb96a1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.699605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.699605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.703708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa238563-b9ff-4532-a998-675f5d4d732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.704607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238563-b9ff-4532-a998-675f5d4d732f admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.704894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238563-b9ff-4532-a998-675f5d4d732f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.705167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238563-b9ff-4532-a998-675f5d4d732f admin admin] PATH_INFO: `/v3/projects/f3c2100cf29b483ca2b7ff9999d466f6/users/3f8fb42e7d12432eaadaccf8e1a9a4cf/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.707109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa238563-b9ff-4532-a998-675f5d4d732f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c2100cf29b483ca2b7ff9999d466f6, user_id=3f8fb42e7d12432eaadaccf8e1a9a4cf, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.709943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa238563-b9ff-4532-a998-675f5d4d732f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.720095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1047/2072] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:19 2022] PUT /identity/v3/projects/f3c2100cf29b483ca2b7ff9999d466f6/users/3f8fb42e7d12432eaadaccf8e1a9a4cf/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:19.731046 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.731337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.731620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.756839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.758167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.759133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] MFA Rules not processed for user `3f8fb42e7d12432eaadaccf8e1a9a4cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:19.760596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:19.767132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1026/2073] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:19.791783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.802395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54e536-a03b-473d-b401-e1e7f674c524 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.831301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1048/2074] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:19.842741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:19.844130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:19.861774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.862680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.863082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.863356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] PATH_INFO: `/v3/users/0d184898c0b644dc98f549e056c1baf0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.864854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d184898c0b644dc98f549e056c1baf0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.867738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.882666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:19.910195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801034d0-cd05-4c89-81fc-39161ec22472 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:19.914188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50e69-14db-489e-811e-549bd1e765cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:19.914844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50e69-14db-489e-811e-549bd1e765cf service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.915122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50e69-14db-489e-811e-549bd1e765cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.915403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50e69-14db-489e-811e-549bd1e765cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.917556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d184898c0b644dc98f549e056c1baf0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:19.918200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d184898c0b644dc98f549e056c1baf0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:19.918815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d184898c0b644dc98f549e056c1baf0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:19.924932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50e69-14db-489e-811e-549bd1e765cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:19.926489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50e69-14db-489e-811e-549bd1e765cf service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:19.931125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d184898c0b644dc98f549e056c1baf0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:19.937775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1049/2075] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:14:19.938997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d184898c0b644dc98f549e056c1baf0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:19.954658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1027/2076] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:19 2022] DELETE /identity/v3/users/0d184898c0b644dc98f549e056c1baf0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:19.959396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:19.959668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:19.960141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:19.979029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:19.980272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:20.008629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:20.018693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.020130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:20.042860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1050/2077] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:20.053354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.055522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:20.078546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24798d90-7427-47dd-b188-75448504ba6e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.082171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f93ddb-4f7d-4c7c-9821-25d8740fdabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.082917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f93ddb-4f7d-4c7c-9821-25d8740fdabd service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.083235 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f93ddb-4f7d-4c7c-9821-25d8740fdabd service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.083512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f93ddb-4f7d-4c7c-9821-25d8740fdabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.085722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d7f93ddb-4f7d-4c7c-9821-25d8740fdabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:20.111126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a6cd3-9af6-4ed2-905e-c00a8f69f671 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.114739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.115378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.115659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.116578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.125786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.127323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.137909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1051/2078] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:20.147556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f93ddb-4f7d-4c7c-9821-25d8740fdabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.149224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f93ddb-4f7d-4c7c-9821-25d8740fdabd service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.158774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1028/2079] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:20.422229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.423849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:20.440706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c959d1f-a93c-4e2c-9767-ad05d0146da6 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.445708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.446684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.446975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.447262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] PATH_INFO: `/v3/projects/c35bc14ede4043eabee0ff92c1284be7` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.448515 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35bc14ede4043eabee0ff92c1284be7)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.450784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.527364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35bc14ede4043eabee0ff92c1284be7', 'request_id': 'req-676de9d1-fccf-4d4b-8447-fb5619a645ed'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:20.533578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35bc14ede4043eabee0ff92c1284be7', 'request_id': 'req-676de9d1-fccf-4d4b-8447-fb5619a645ed'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:20.541315 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35bc14ede4043eabee0ff92c1284be7', 'request_id': 'req-676de9d1-fccf-4d4b-8447-fb5619a645ed'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:20.552003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] The token cache is being invalidate because project c35bc14ede4043eabee0ff92c1284be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:20.552311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:20.552943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-676de9d1-fccf-4d4b-8447-fb5619a645ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:20.555554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1052/2080] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:20 2022] DELETE /identity/v3/projects/c35bc14ede4043eabee0ff92c1284be7 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:20.560143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f916f-f83b-4ebb-8ce4-8590d5547c01 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.560498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f916f-f83b-4ebb-8ce4-8590d5547c01 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.560781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f916f-f83b-4ebb-8ce4-8590d5547c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.578787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ce5f916f-f83b-4ebb-8ce4-8590d5547c01 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:20.580051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ce5f916f-f83b-4ebb-8ce4-8590d5547c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:20.630731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:20.651925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1029/2081] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:20.659618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d406-bc1d-4a41-8ea4-27685a156164 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.659910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d406-bc1d-4a41-8ea4-27685a156164 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.660221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d406-bc1d-4a41-8ea4-27685a156164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.680221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5425d406-bc1d-4a41-8ea4-27685a156164 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:20.681447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5425d406-bc1d-4a41-8ea4-27685a156164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:20.689411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1053/2082] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:20.693616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f916f-f83b-4ebb-8ce4-8590d5547c01 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.704403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f916f-f83b-4ebb-8ce4-8590d5547c01 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.709124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.709777 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.710600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.710877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.711607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:20.711915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.713548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.724876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1030/2083] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:20.729395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d406-bc1d-4a41-8ea4-27685a156164 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.738857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d406-bc1d-4a41-8ea4-27685a156164 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.744034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.744707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.744989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.745264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.745957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.747837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.773971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1054/2084] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:20 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:20.778076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.788151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05903d97-d202-4904-aa4f-94fd980c73e8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.844488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.845149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.845433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.845726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.846403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.848363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.868844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1031/2085] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:20 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:20.872884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.883297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25dd9d-69d4-4bc4-8ba8-a700ea611137 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.887921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.888617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.888905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.889184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.889926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.891519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.902517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1055/2086] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:20.906599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.917520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e82215-f6af-4249-b3ee-9f55ece0778d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.922562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32620a-0f52-4e94-ab8e-f23540137dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.923263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32620a-0f52-4e94-ab8e-f23540137dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.923548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32620a-0f52-4e94-ab8e-f23540137dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.923828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32620a-0f52-4e94-ab8e-f23540137dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.924606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32620a-0f52-4e94-ab8e-f23540137dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.926238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32620a-0f52-4e94-ab8e-f23540137dc2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.937483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1032/2087] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:20.941587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:20.951374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a509d5b1-5187-4faf-b4f7-bb1ff27646d4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:20.955973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:20.956878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.957160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.957432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] PATH_INFO: `/v3/projects/0a667c6d13514cc4bdaaf4598bc723d4/users/2d1d69a29709455d9d9dc596ecbb870d/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:20.972085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a667c6d13514cc4bdaaf4598bc723d4, user_id=2d1d69a29709455d9d9dc596ecbb870d, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:20.974750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:20.977620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:20.989366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1056/2088] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:20 2022] PUT /identity/v3/projects/0a667c6d13514cc4bdaaf4598bc723d4/users/2d1d69a29709455d9d9dc596ecbb870d/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:20.994491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86b02f-95c2-453c-86cc-9079c2757fdc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:20.994787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86b02f-95c2-453c-86cc-9079c2757fdc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:20.995069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86b02f-95c2-453c-86cc-9079c2757fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:21.013054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-db86b02f-95c2-453c-86cc-9079c2757fdc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:21.014365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db86b02f-95c2-453c-86cc-9079c2757fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:21.075190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1033/2089] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:21.085468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:21.087251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:21.143719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953b415-e99f-4768-9615-28e28407baa8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:21.147928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:21.148696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:21.148981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:21.149257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:21.158266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:21.159684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:21.169162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1057/2090] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:21.817486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dec1fe-23da-40bb-add0-72eeec06896f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:21.817781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dec1fe-23da-40bb-add0-72eeec06896f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:21.818062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dec1fe-23da-40bb-add0-72eeec06896f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:21.844988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b3dec1fe-23da-40bb-add0-72eeec06896f None None] MFA Rules not processed for user `2d1d69a29709455d9d9dc596ecbb870d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:21.846113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b3dec1fe-23da-40bb-add0-72eeec06896f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:21.888935 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:21.917608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1034/2091] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:21.929263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:21.930744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:21.995927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b968b4-1fa1-4cc1-98a7-054260be539e service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:21.999704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:22.000408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:22.000691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:22.000966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:22.009980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:22.011453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:22.020203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1058/2092] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:23.375207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c511-2315-4328-988a-181a400ae72e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:23.375751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c511-2315-4328-988a-181a400ae72e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:23.375843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c511-2315-4328-988a-181a400ae72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:23.395986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fae5c511-2315-4328-988a-181a400ae72e None None] MFA Rules not processed for user `2d1d69a29709455d9d9dc596ecbb870d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:23.397903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fae5c511-2315-4328-988a-181a400ae72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:23.404959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1035/2093] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:25.484513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:25.486864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:25.511496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f3776-26e4-44ed-9e48-18884042b161 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:25.523332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:25.524321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:25.525114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:25.525530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] PATH_INFO: `/v3/users/f6763fe25ab34ffd8464005090f50283` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:25.537338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6763fe25ab34ffd8464005090f50283)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:25.540914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:25.660785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6763fe25ab34ffd8464005090f50283'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:25.664848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6763fe25ab34ffd8464005090f50283'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:25.671243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6763fe25ab34ffd8464005090f50283'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:25.699197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6763fe25ab34ffd8464005090f50283'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:25.713077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6763fe25ab34ffd8464005090f50283'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:25.755423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1059/2094] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:25 2022] DELETE /identity/v3/users/f6763fe25ab34ffd8464005090f50283 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:25.761014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:25.762230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:25.762655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:25.789888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:25.791123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:25.873933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1036/2095] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:25.888652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:25.890317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:25.911005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:25.972667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5394f-3cc7-4477-90a6-37704de2dc72 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:25.981157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:25.982873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:25.983163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:25.983439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:25.995584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:25.997076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:26.021659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1060/2096] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:26.833433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:26.836413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:26.854194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385278f5-5784-4767-97a2-81fd70c67c03 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:26.860351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:26.861921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:26.862444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:26.862914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] PATH_INFO: `/v3/projects/c58e5ea2f0954e539fd2033a91b9a7c6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:26.868507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58e5ea2f0954e539fd2033a91b9a7c6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:26.870681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:26.999956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58e5ea2f0954e539fd2033a91b9a7c6', 'request_id': 'req-ea6927ee-2f82-4076-a607-b4e9bee76f72'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.009190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58e5ea2f0954e539fd2033a91b9a7c6', 'request_id': 'req-ea6927ee-2f82-4076-a607-b4e9bee76f72'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.028925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58e5ea2f0954e539fd2033a91b9a7c6', 'request_id': 'req-ea6927ee-2f82-4076-a607-b4e9bee76f72'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.076813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] The token cache is being invalidate because project c58e5ea2f0954e539fd2033a91b9a7c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:27.079207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.087470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.092987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1037/2097] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:26 2022] DELETE /identity/v3/projects/c58e5ea2f0954e539fd2033a91b9a7c6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:27.096819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:27.119345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee250f8-37c6-442f-b397-f0bd3ad6c0ad service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:27.215362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:27.216301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:27.221992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:27.222164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] PATH_INFO: `/v3/users/3f8fb42e7d12432eaadaccf8e1a9a4cf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:27.224238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8fb42e7d12432eaadaccf8e1a9a4cf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:27.227019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:27.354018 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8fb42e7d12432eaadaccf8e1a9a4cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.355490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8fb42e7d12432eaadaccf8e1a9a4cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.356611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8fb42e7d12432eaadaccf8e1a9a4cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.377357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8fb42e7d12432eaadaccf8e1a9a4cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.393799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8fb42e7d12432eaadaccf8e1a9a4cf'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:27.433920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1061/2098] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:27 2022] DELETE /identity/v3/users/3f8fb42e7d12432eaadaccf8e1a9a4cf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:28.008991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:28.010802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:28.024934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6927ee-2f82-4076-a607-b4e9bee76f72 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:28.082755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:28.096831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:28.098961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.099622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.099991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] PATH_INFO: `/v3/users/26922cee7b794e0ca8cec43b6f5daff2` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.104077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26922cee7b794e0ca8cec43b6f5daff2)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:28.107345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:28.185305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26922cee7b794e0ca8cec43b6f5daff2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.185952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26922cee7b794e0ca8cec43b6f5daff2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.186610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26922cee7b794e0ca8cec43b6f5daff2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.203481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26922cee7b794e0ca8cec43b6f5daff2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.215493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26922cee7b794e0ca8cec43b6f5daff2'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.233416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1038/2099] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:28 2022] DELETE /identity/v3/users/26922cee7b794e0ca8cec43b6f5daff2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:28.335523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:28.337160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:28.358509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372bcab-4c31-43f2-a6bd-21511a0ada90 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:28.416521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:28.464271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:28.465337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.465776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.466367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] PATH_INFO: `/v3/projects/f3c2100cf29b483ca2b7ff9999d466f6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.467741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c2100cf29b483ca2b7ff9999d466f6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:28.470088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:28.534072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c2100cf29b483ca2b7ff9999d466f6', 'request_id': 'req-a633616c-4204-4b0e-8add-ba7f9bb051f5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.542116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c2100cf29b483ca2b7ff9999d466f6', 'request_id': 'req-a633616c-4204-4b0e-8add-ba7f9bb051f5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.553054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c2100cf29b483ca2b7ff9999d466f6', 'request_id': 'req-a633616c-4204-4b0e-8add-ba7f9bb051f5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.563562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:28.565429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:28.580614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3560a0-697c-4cc5-855f-f29111c9dd29 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:28.628363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] The token cache is being invalidate because project f3c2100cf29b483ca2b7ff9999d466f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:28.632165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.633054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a633616c-4204-4b0e-8add-ba7f9bb051f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.638324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1062/2100] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:28 2022] DELETE /identity/v3/projects/f3c2100cf29b483ca2b7ff9999d466f6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:28.644841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b874-84cc-4fb7-8cdf-947c724f17ee None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.645155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b874-84cc-4fb7-8cdf-947c724f17ee None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.645466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b874-84cc-4fb7-8cdf-947c724f17ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.668132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:28.669811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.670241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.670790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] PATH_INFO: `/v3/projects/87f4749861b548a6808e215ab16497d9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.672259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f4749861b548a6808e215ab16497d9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:28.674569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:28.696889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-dae4b874-84cc-4fb7-8cdf-947c724f17ee None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:28.723920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dae4b874-84cc-4fb7-8cdf-947c724f17ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:28.750558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f4749861b548a6808e215ab16497d9', 'request_id': 'req-6d5cc463-e80d-4432-92eb-d14efc0f2691'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.755871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1063/2101] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:28.765280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c35f-1d66-4c58-a5f4-0d074de39954 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.765570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c35f-1d66-4c58-a5f4-0d074de39954 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.765858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1c35f-1d66-4c58-a5f4-0d074de39954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.776745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f4749861b548a6808e215ab16497d9', 'request_id': 'req-6d5cc463-e80d-4432-92eb-d14efc0f2691'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.796672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f4749861b548a6808e215ab16497d9', 'request_id': 'req-6d5cc463-e80d-4432-92eb-d14efc0f2691'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.801055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-60d1c35f-1d66-4c58-a5f4-0d074de39954 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:28.802309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-60d1c35f-1d66-4c58-a5f4-0d074de39954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:28.826076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] The token cache is being invalidate because project 87f4749861b548a6808e215ab16497d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:28.829067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.832213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6d5cc463-e80d-4432-92eb-d14efc0f2691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:28.840435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1039/2102] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:28 2022] DELETE /identity/v3/projects/87f4749861b548a6808e215ab16497d9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:28.842074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013995-1a0a-4ced-8b7d-7c59ba2f2849 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.842492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013995-1a0a-4ced-8b7d-7c59ba2f2849 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.843066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5013995-1a0a-4ced-8b7d-7c59ba2f2849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.860372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:28.870034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c5013995-1a0a-4ced-8b7d-7c59ba2f2849 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:28.871705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c5013995-1a0a-4ced-8b7d-7c59ba2f2849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:28.917117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1064/2103] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:28.922872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c35f-1d66-4c58-a5f4-0d074de39954 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:28.938481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1c35f-1d66-4c58-a5f4-0d074de39954 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:28.946151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:28.947700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.947918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.948965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.949765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:28.950077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:28.953445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:28.966159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1040/2104] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:28.976092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30b3db-cf19-424d-9b26-9b800e1f9529 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:28.976762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30b3db-cf19-424d-9b26-9b800e1f9529 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:28.977247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30b3db-cf19-424d-9b26-9b800e1f9529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:28.985877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1065/2105] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:28.987701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.002132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6a840-4489-4605-a09a-7f3b5486d5be admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.008691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.009400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.009750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.010036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.010783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.013377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.022111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3a30b3db-cf19-424d-9b26-9b800e1f9529 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:29.025764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3a30b3db-cf19-424d-9b26-9b800e1f9529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:29.043408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1041/2106] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:29.044742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30b3db-cf19-424d-9b26-9b800e1f9529 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.058259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1066/2107] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:28 2022] POST /identity/v3/projects => generated 409 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:29.063131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.064239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30b3db-cf19-424d-9b26-9b800e1f9529 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.102513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:29.158035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.158737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.159218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.159702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.160528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:29.160839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.162846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.163904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469cc9b-6b7c-40a2-a374-1b3df5516baf admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.170049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.171067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.171614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.172092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.173083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.179173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.182516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1042/2108] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:29.187396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.201570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1067/2109] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:29 2022] POST /identity/v3/users => generated 305 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:29.201735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12ec55-f174-402f-b5cb-559e41016807 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.202633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.207058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.207892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.208182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.208483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.209171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.212442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.214525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07de55-4cbb-4746-a11c-119a6fa68ce6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.224051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.224676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.225071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.226051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.227021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.228877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.240582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1068/2110] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:29.244559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.251604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1043/2111] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:29 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:29.252505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.255213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b9ee5-15b3-4dac-a383-5b2986819530 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.330117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacf779-f073-4674-b073-df93a1089f25 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.335352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.336015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.336330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.336603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.337287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.337824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.338500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.338803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.339083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.339198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.339807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.341463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.352980 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1069/2112] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:29.357224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.362794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1044/2113] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:29 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:29.364014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.367369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b32949-3563-487e-ad6b-03e67c849d31 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.369408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:29.372590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d06db-d593-49ad-a6d5-89fde30fae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.373493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d06db-d593-49ad-a6d5-89fde30fae2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.373778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d06db-d593-49ad-a6d5-89fde30fae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.374056 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d06db-d593-49ad-a6d5-89fde30fae2a admin admin] PATH_INFO: `/v3/projects/a3e8276312d14e4497bdb7cd35c0ed80/users/0ad783060f5f4ea98a094a9ba69b158c/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.375900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ef3b-c473-41cb-b1b5-8ac014fe350c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.385537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.386631 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.386631 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.386825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.387466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.389165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.393017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d06db-d593-49ad-a6d5-89fde30fae2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e8276312d14e4497bdb7cd35c0ed80, user_id=0ad783060f5f4ea98a094a9ba69b158c, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.395667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d06db-d593-49ad-a6d5-89fde30fae2a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.400077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1045/2114] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:29.403954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.415113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb437ed7-40aa-471c-8270-951ca16d4ba7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.416244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1070/2115] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:29 2022] PUT /identity/v3/projects/a3e8276312d14e4497bdb7cd35c0ed80/users/0ad783060f5f4ea98a094a9ba69b158c/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:29.423364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d47b-007d-4974-a429-ffe2906c51d1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.423654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d47b-007d-4974-a429-ffe2906c51d1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.423934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118d47b-007d-4974-a429-ffe2906c51d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.450788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a118d47b-007d-4974-a429-ffe2906c51d1 None None] MFA Rules not processed for user `0ad783060f5f4ea98a094a9ba69b158c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:29.452071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a118d47b-007d-4974-a429-ffe2906c51d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:29.473765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.474438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.474722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.475000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.475877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.477566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.491365 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1046/2116] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:29.492692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.505795 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaa431-cbbd-4aa3-a344-f10de234f49e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.511676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707b913-af04-45bc-be97-8ec3748aad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.512590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707b913-af04-45bc-be97-8ec3748aad98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.512871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707b913-af04-45bc-be97-8ec3748aad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.513143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707b913-af04-45bc-be97-8ec3748aad98 admin admin] PATH_INFO: `/v3/projects/6b341c2d77764f3890f2501cfc6945a7/users/1d410832e6584828875128e31baa0ae8/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.525880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1071/2117] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:29.530701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118d47b-007d-4974-a429-ffe2906c51d1 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.532101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707b913-af04-45bc-be97-8ec3748aad98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b341c2d77764f3890f2501cfc6945a7, user_id=1d410832e6584828875128e31baa0ae8, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.534870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707b913-af04-45bc-be97-8ec3748aad98 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.536062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:29.543614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118d47b-007d-4974-a429-ffe2906c51d1 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.548604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1047/2118] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:29 2022] PUT /identity/v3/projects/6b341c2d77764f3890f2501cfc6945a7/users/1d410832e6584828875128e31baa0ae8/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:29.553899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb725b-d6fc-45ae-8eb6-9f0e12f9dc35 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.554389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb725b-d6fc-45ae-8eb6-9f0e12f9dc35 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.554679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb725b-d6fc-45ae-8eb6-9f0e12f9dc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.573509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b3eb725b-d6fc-45ae-8eb6-9f0e12f9dc35 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:29.574844 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b3eb725b-d6fc-45ae-8eb6-9f0e12f9dc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:29.609258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.610008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.610383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.610991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.611841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.613893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.639662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1048/2119] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:29.641766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1072/2120] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:29 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:29.649058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb725b-d6fc-45ae-8eb6-9f0e12f9dc35 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.652816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.654640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:29.658865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb725b-d6fc-45ae-8eb6-9f0e12f9dc35 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.716947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55719b5e-9d79-4ff4-8f31-497b77ae2ae3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.720560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.721352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.721664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.722186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.723127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.723803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.724087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.724397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.725094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.728339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.732719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.734145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.737617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:29.748661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1073/2121] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:14:29.751040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1049/2122] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:29 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:29.755055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.765476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a70dae0-0d6d-41b4-920e-7733370858df service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.770536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.771187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.771470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.771755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.773394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.775163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.792742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1074/2123] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:29.793877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.805041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5949cf-1421-496f-8653-284179ad9428 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.809783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.810704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.810988 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.811437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] PATH_INFO: `/v3/projects/be582a53681d4dda911cf22d7cb80231/users/fc867c6fa3434bdd99ae1e72de87c334/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.828846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be582a53681d4dda911cf22d7cb80231, user_id=fc867c6fa3434bdd99ae1e72de87c334, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.831511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.853295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1050/2124] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:29 2022] PUT /identity/v3/projects/be582a53681d4dda911cf22d7cb80231/users/fc867c6fa3434bdd99ae1e72de87c334/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:29.854690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:29.868523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec9b42-ff88-41df-ad63-c796e16dbc53 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:29.963881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355a02d-c5f0-424c-ac87-6e525341df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:29.964599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355a02d-c5f0-424c-ac87-6e525341df47 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:29.964920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355a02d-c5f0-424c-ac87-6e525341df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:29.965153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355a02d-c5f0-424c-ac87-6e525341df47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:29.965893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355a02d-c5f0-424c-ac87-6e525341df47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:29.967593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355a02d-c5f0-424c-ac87-6e525341df47 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:29.992549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1075/2125] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:30.002186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:30.013699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe69c75-cc9a-403b-be99-2508249daa0e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:30.018424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:30.019319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:30.019732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:30.020006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] PATH_INFO: `/v3/projects/be582a53681d4dda911cf22d7cb80231/users/fc867c6fa3434bdd99ae1e72de87c334/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:30.022195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be582a53681d4dda911cf22d7cb80231, user_id=fc867c6fa3434bdd99ae1e72de87c334, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:30.034825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:30.051154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1051/2126] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:30 2022] PUT /identity/v3/projects/be582a53681d4dda911cf22d7cb80231/users/fc867c6fa3434bdd99ae1e72de87c334/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:30.063399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef315-96fa-41fb-8370-86f5468275d2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:30.063851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef315-96fa-41fb-8370-86f5468275d2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:30.064263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eef315-96fa-41fb-8370-86f5468275d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:30.103442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e1eef315-96fa-41fb-8370-86f5468275d2 None None] MFA Rules not processed for user `fc867c6fa3434bdd99ae1e72de87c334`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:30.105107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e1eef315-96fa-41fb-8370-86f5468275d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:30.111883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:30.273507 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1076/2127] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:30.290404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:30.292276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:30.385390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270c646-12be-4145-9035-c5d65f93793e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:30.392286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608f099-fe76-4777-9047-dcbb96ac0c4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:30.393087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f099-fe76-4777-9047-dcbb96ac0c4b service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:30.393388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f099-fe76-4777-9047-dcbb96ac0c4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:30.394180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f099-fe76-4777-9047-dcbb96ac0c4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:30.407586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f099-fe76-4777-9047-dcbb96ac0c4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:30.409084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f099-fe76-4777-9047-dcbb96ac0c4b service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:30.424257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1052/2128] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:30.612082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef315-96fa-41fb-8370-86f5468275d2 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:30.623561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eef315-96fa-41fb-8370-86f5468275d2 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:30.627383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a629e49-3438-42d6-886c-05c8672b0ab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:30.628335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a629e49-3438-42d6-886c-05c8672b0ab7 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:30.628633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a629e49-3438-42d6-886c-05c8672b0ab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:30.628915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a629e49-3438-42d6-886c-05c8672b0ab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:30.738227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a629e49-3438-42d6-886c-05c8672b0ab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:30.746372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a629e49-3438-42d6-886c-05c8672b0ab7 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:30.773310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1077/2129] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:35.467484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:35.470625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:35.470932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:35.520153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] MFA Rules not processed for user `1d410832e6584828875128e31baa0ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:35.520153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:35.612218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1053/2130] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:35.623077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f99da4-6738-41cc-9e69-8f1e4a35c440 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:35.623634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f99da4-6738-41cc-9e69-8f1e4a35c440 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:35.623634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f99da4-6738-41cc-9e69-8f1e4a35c440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:35.652289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-92f99da4-6738-41cc-9e69-8f1e4a35c440 None None] MFA Rules not processed for user `1d410832e6584828875128e31baa0ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:35.653403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-92f99da4-6738-41cc-9e69-8f1e4a35c440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:35.660940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1078/2131] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:14:35.671705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:35.673163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:35.726964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:35.758249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843e65c-a5c5-4fcd-b7a5-8f4026f1a276 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:35.764451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:35.765116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:35.765402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:35.765681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:35.774843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:35.776617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:35.786703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1054/2132] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:37.364866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5435-f650-4ff5-8988-47b4273e698a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:37.365380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5435-f650-4ff5-8988-47b4273e698a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:37.365487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd5435-f650-4ff5-8988-47b4273e698a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:37.415376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-19dd5435-f650-4ff5-8988-47b4273e698a None None] MFA Rules not processed for user `1d410832e6584828875128e31baa0ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:37.419596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-19dd5435-f650-4ff5-8988-47b4273e698a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:37.435158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1079/2133] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:39.999358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:40.112585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e741db-b754-4509-89c5-a4ce54bcd1a7 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:40.125054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:40.126164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:40.135901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:40.136510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] PATH_INFO: `/v3/users/0ad783060f5f4ea98a094a9ba69b158c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:40.139811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad783060f5f4ea98a094a9ba69b158c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:40.144212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:40.252957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad783060f5f4ea98a094a9ba69b158c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:40.253918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad783060f5f4ea98a094a9ba69b158c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:40.254772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad783060f5f4ea98a094a9ba69b158c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:40.280392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad783060f5f4ea98a094a9ba69b158c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:40.299525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad783060f5f4ea98a094a9ba69b158c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:40.346763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1055/2134] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:39 2022] DELETE /identity/v3/users/0ad783060f5f4ea98a094a9ba69b158c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:40.352296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:40.353311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:40.353864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:40.379335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:40.380929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:40.500335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1080/2135] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:40.513628 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:40.516931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:40.586665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d896449a-fbce-4914-a06c-4bee90f6088c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:40.594945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:40.594945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:40.594945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:40.594945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:40.610061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:40.612781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:40.614665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:40.633091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1056/2136] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:40.980636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:40.983304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:41.012301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76de29f-e2c4-4514-91c3-ef5109366764 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:41.021263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:41.024113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:41.024642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:41.039814 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] PATH_INFO: `/v3/projects/a3e8276312d14e4497bdb7cd35c0ed80` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:41.041610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e8276312d14e4497bdb7cd35c0ed80)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:41.043825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:41.071268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:41.101322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e8276312d14e4497bdb7cd35c0ed80', 'request_id': 'req-8439391b-422f-42c7-8fab-f23c425edab4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.110623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e8276312d14e4497bdb7cd35c0ed80', 'request_id': 'req-8439391b-422f-42c7-8fab-f23c425edab4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.122489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e8276312d14e4497bdb7cd35c0ed80', 'request_id': 'req-8439391b-422f-42c7-8fab-f23c425edab4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.137061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] The token cache is being invalidate because project a3e8276312d14e4497bdb7cd35c0ed80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:41.137280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.138068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.142082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1081/2137] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:40 2022] DELETE /identity/v3/projects/a3e8276312d14e4497bdb7cd35c0ed80 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:41.146161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:41.159868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5be14-8512-4902-add6-16c916653a93 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:41.235840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:41.237040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:41.237466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:41.237749 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] PATH_INFO: `/v3/users/fc867c6fa3434bdd99ae1e72de87c334` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:41.239785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc867c6fa3434bdd99ae1e72de87c334)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:41.243613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:41.307033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc867c6fa3434bdd99ae1e72de87c334'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.307733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc867c6fa3434bdd99ae1e72de87c334'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.308748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc867c6fa3434bdd99ae1e72de87c334'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.331119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc867c6fa3434bdd99ae1e72de87c334'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.348025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f2b2afe5-99e9-406d-86be-18df0bc0ac95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc867c6fa3434bdd99ae1e72de87c334'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.369491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1057/2138] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:41 2022] DELETE /identity/v3/users/fc867c6fa3434bdd99ae1e72de87c334 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:41.801239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:41.804802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:41.847012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8439391b-422f-42c7-8fab-f23c425edab4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:41.930990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:41.931899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:41.932198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:41.932477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] PATH_INFO: `/v3/projects/be582a53681d4dda911cf22d7cb80231` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:41.933772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be582a53681d4dda911cf22d7cb80231)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:41.935687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:41.986292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be582a53681d4dda911cf22d7cb80231', 'request_id': 'req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:41.994397 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be582a53681d4dda911cf22d7cb80231', 'request_id': 'req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:42.004334 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be582a53681d4dda911cf22d7cb80231', 'request_id': 'req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:42.039596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] The token cache is being invalidate because project be582a53681d4dda911cf22d7cb80231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:42.054257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:42.055079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c5c6204d-7d6f-49fe-8f5e-b25a4a560b5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:42.060129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1082/2139] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:41 2022] DELETE /identity/v3/projects/be582a53681d4dda911cf22d7cb80231 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:42.065224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5430ce-e22c-4eb9-811a-f90dfe47012d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.065582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5430ce-e22c-4eb9-811a-f90dfe47012d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.065861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5430ce-e22c-4eb9-811a-f90dfe47012d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.093090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7d5430ce-e22c-4eb9-811a-f90dfe47012d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:42.095323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7d5430ce-e22c-4eb9-811a-f90dfe47012d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:42.181767 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1058/2140] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:42.190941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8661-1f7c-4d26-8b3c-f755fbd981eb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.191291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8661-1f7c-4d26-8b3c-f755fbd981eb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.191514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc8661-1f7c-4d26-8b3c-f755fbd981eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.213445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-75cc8661-1f7c-4d26-8b3c-f755fbd981eb None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:42.215019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-75cc8661-1f7c-4d26-8b3c-f755fbd981eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:42.228427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1083/2141] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:42.231278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5430ce-e22c-4eb9-811a-f90dfe47012d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:42.242261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5430ce-e22c-4eb9-811a-f90dfe47012d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:42.247622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:42.248370 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.248619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.248917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.249675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:42.249982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:42.253333 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:42.268067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1059/2142] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:42.272811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc8661-1f7c-4d26-8b3c-f755fbd981eb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:42.283868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc8661-1f7c-4d26-8b3c-f755fbd981eb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:42.289638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:42.290509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.290800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.291082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.291781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:42.293722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:42.329139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1084/2143] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:42 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:42.330759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:42.338192 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:42.347551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b36a5-f0a0-4766-b202-09f839ac5602 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:42.418534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:42.419466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.420018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.420580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.421426 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:42.423530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:42.456843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1060/2144] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:42 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:42.458394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:42.470182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffa521-d023-477b-ae74-d6b5db8cf730 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:42.475107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:42.477027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.477313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.477593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.478324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:42.479929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:42.486312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:42.494713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1085/2145] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:14:42.497927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:42.508310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3328a9-65fd-479d-a939-4b2c4d9bfb47 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:42.512959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29549f44-07bc-4141-9694-95ee5dbe3e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:42.513623 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549f44-07bc-4141-9694-95ee5dbe3e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.513907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549f44-07bc-4141-9694-95ee5dbe3e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.514186 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29549f44-07bc-4141-9694-95ee5dbe3e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.514916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29549f44-07bc-4141-9694-95ee5dbe3e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:42.516680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29549f44-07bc-4141-9694-95ee5dbe3e91 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:42.534871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1061/2146] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:42.537189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:42.547848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984aebb-d140-4f59-82ee-1f2a3bb48180 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:42.558527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:42.560413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.560629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.561233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] PATH_INFO: `/v3/projects/a7bda3fc37c64addabced03e2e92eb50/users/090b11c58a8b40dc9dbaf934a33bddc6/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.579254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7bda3fc37c64addabced03e2e92eb50, user_id=090b11c58a8b40dc9dbaf934a33bddc6, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:42.582469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:42.620823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1086/2147] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:42 2022] PUT /identity/v3/projects/a7bda3fc37c64addabced03e2e92eb50/users/090b11c58a8b40dc9dbaf934a33bddc6/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:42.630499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.630794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.631087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.667811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] MFA Rules not processed for user `090b11c58a8b40dc9dbaf934a33bddc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:42.669198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:42.760473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1062/2148] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:42.773385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:42.775187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:42.840744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6021-0660-40cf-8eed-4eb45c722832 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:42.845363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8ee0d-50fc-4db4-a483-615f1d710c02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd5a266491c487385349368b5ccbbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:42.846111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ee0d-50fc-4db4-a483-615f1d710c02 service glance] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:42.846303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ee0d-50fc-4db4-a483-615f1d710c02 service glance] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:42.846582 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8ee0d-50fc-4db4-a483-615f1d710c02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:42.857168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8ee0d-50fc-4db4-a483-615f1d710c02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:42.858540 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8ee0d-50fc-4db4-a483-615f1d710c02 service glance] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:42.869693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1087/2149] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:50.054396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:50.055861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:50.123025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ba66-96ce-4cb0-8170-138c20abc46c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:50.127433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:50.128327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:50.128607 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:50.128878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] PATH_INFO: `/v3/users/6309d4b397f948b0b7d2c92ae65b76eb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:50.130054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6309d4b397f948b0b7d2c92ae65b76eb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:50.132905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:50.146996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:50.183310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6309d4b397f948b0b7d2c92ae65b76eb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.183992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6309d4b397f948b0b7d2c92ae65b76eb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.184630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6309d4b397f948b0b7d2c92ae65b76eb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.198920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6309d4b397f948b0b7d2c92ae65b76eb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.210823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6309d4b397f948b0b7d2c92ae65b76eb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.225733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1063/2150] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:14:50 2022] DELETE /identity/v3/users/6309d4b397f948b0b7d2c92ae65b76eb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:50.230420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:50.230883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:50.231146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:50.248847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:50.250042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:50.311081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1088/2151] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:50.321582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:50.323274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:50.387175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52542264-1ecf-49a0-9a9a-9aa373dc395d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:50.391959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00824d-2e20-4cc5-8c05-71234c936ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:50.392797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00824d-2e20-4cc5-8c05-71234c936ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:50.393123 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00824d-2e20-4cc5-8c05-71234c936ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:50.393445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00824d-2e20-4cc5-8c05-71234c936ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:50.404687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00824d-2e20-4cc5-8c05-71234c936ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:50.406329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f00824d-2e20-4cc5-8c05-71234c936ff2 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:50.420436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1064/2152] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:50.789195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:50.790669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:50.802555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301bfa2-e75b-423f-a217-04ca8b3744f3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:50.808013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:50.808942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:50.809221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:50.809496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] PATH_INFO: `/v3/projects/a5997fe314aa4ab4a13b8dfe60f82143` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:50.820493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5997fe314aa4ab4a13b8dfe60f82143)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:50.822440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:50.882335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5997fe314aa4ab4a13b8dfe60f82143', 'request_id': 'req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.892933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5997fe314aa4ab4a13b8dfe60f82143', 'request_id': 'req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.905422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5997fe314aa4ab4a13b8dfe60f82143', 'request_id': 'req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.917538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] The token cache is being invalidate because project a5997fe314aa4ab4a13b8dfe60f82143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:14:50.917819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.918458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-01e0faf2-d9a7-4718-b496-4ecf5ba6a51f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:14:50.919988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1089/2153] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:14:50 2022] DELETE /identity/v3/projects/a5997fe314aa4ab4a13b8dfe60f82143 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:14:50.924720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522ea7-c88b-47f0-bfca-f085cf273bdf None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:50.925013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522ea7-c88b-47f0-bfca-f085cf273bdf None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:50.925287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522ea7-c88b-47f0-bfca-f085cf273bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:50.943472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4a522ea7-c88b-47f0-bfca-f085cf273bdf None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:50.945589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4a522ea7-c88b-47f0-bfca-f085cf273bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:51.008699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1065/2154] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:51.016555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da36ca-5452-41b3-9736-57a42c5d8f67 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.016852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da36ca-5452-41b3-9736-57a42c5d8f67 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.017133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da36ca-5452-41b3-9736-57a42c5d8f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.023558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:51.040901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-84da36ca-5452-41b3-9736-57a42c5d8f67 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:51.042169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-84da36ca-5452-41b3-9736-57a42c5d8f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:51.050213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1090/2155] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:51.055492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522ea7-c88b-47f0-bfca-f085cf273bdf None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:51.066053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522ea7-c88b-47f0-bfca-f085cf273bdf None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:51.071181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:51.071851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.072125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.072445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.073214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:14:51.073659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:51.075297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:51.088756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1066/2156] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:14:51.093470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da36ca-5452-41b3-9736-57a42c5d8f67 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:51.103753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da36ca-5452-41b3-9736-57a42c5d8f67 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:51.108459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:51.109123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.109437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.109718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.110416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:51.112620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:51.146850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1091/2157] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:14:51 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:14:51.151042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:51.161596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38c122-0f89-4b82-a657-868a72042386 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:51.181564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:51.228609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:51.229289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.229570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.229842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.230533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:51.232475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:51.253201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1067/2158] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:14:51 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:14:51.258407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:51.270269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59ffcf-a5ee-4bd5-8ab2-4bdb8efc9e8c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:51.280938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:51.281633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.281917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.282193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.283992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:51.285654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:51.297237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1092/2159] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:51.301260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:51.312568 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e62b6-5ed3-4c57-9fe7-de954441becb admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:51.317134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e30e1-134b-4d2c-adfa-b9a1b7c3f566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:51.317790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e30e1-134b-4d2c-adfa-b9a1b7c3f566 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.318074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e30e1-134b-4d2c-adfa-b9a1b7c3f566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.318351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e30e1-134b-4d2c-adfa-b9a1b7c3f566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.319761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e30e1-134b-4d2c-adfa-b9a1b7c3f566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:51.321395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e30e1-134b-4d2c-adfa-b9a1b7c3f566 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:51.331289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1068/2160] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:14:51.336914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:51.347317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a60db-59d1-4c8b-b951-a86393015b9d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:51.352203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:51.353082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.353439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.353717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] PATH_INFO: `/v3/projects/f05f4bb8ec2543cc846fc2aa243e9353/users/8ab75c66c3964436bf9a6001a3d4494f/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.369255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05f4bb8ec2543cc846fc2aa243e9353, user_id=8ab75c66c3964436bf9a6001a3d4494f, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:51.371912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:51.389511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1093/2161] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:14:51 2022] PUT /identity/v3/projects/f05f4bb8ec2543cc846fc2aa243e9353/users/8ab75c66c3964436bf9a6001a3d4494f/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:14:51.401819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.402216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.402560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.437622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] MFA Rules not processed for user `8ab75c66c3964436bf9a6001a3d4494f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:14:51.437622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:51.501792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1069/2162] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:14:51.513312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:51.515034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:51.578875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b750f4c-51cd-4365-bc95-40b8d3116e39 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:51.582963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:51.583693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:51.584097 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:51.584544 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:51.595664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:51.597197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:51.608510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1094/2163] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:14:52.052420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:14:52.054728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:52.117971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97d0c-cfdb-4f18-afda-2f9543c7b112 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:14:52.121728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dfaa6-4574-4f2b-9409-d1f2b9011986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:14:52.122396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dfaa6-4574-4f2b-9409-d1f2b9011986 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:14:52.122674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dfaa6-4574-4f2b-9409-d1f2b9011986 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:14:52.122949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dfaa6-4574-4f2b-9409-d1f2b9011986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:14:52.124838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0e4dfaa6-4574-4f2b-9409-d1f2b9011986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:14:52.173282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:14:52.197427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dfaa6-4574-4f2b-9409-d1f2b9011986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:14:52.198876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dfaa6-4574-4f2b-9409-d1f2b9011986 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:14:52.208668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1070/2164] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:15:01.565427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:01.629857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f3033-631f-405f-a8e9-e7cb74962d71 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:01.635325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:01.636286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:01.636571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:01.636849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] PATH_INFO: `/v3/users/8ab75c66c3964436bf9a6001a3d4494f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:01.640213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab75c66c3964436bf9a6001a3d4494f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:01.644215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:01.699281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:01.702133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab75c66c3964436bf9a6001a3d4494f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:01.703426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab75c66c3964436bf9a6001a3d4494f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:01.704740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab75c66c3964436bf9a6001a3d4494f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:01.719785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab75c66c3964436bf9a6001a3d4494f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:01.727502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab75c66c3964436bf9a6001a3d4494f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:01.740344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1095/2165] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:15:01 2022] DELETE /identity/v3/users/8ab75c66c3964436bf9a6001a3d4494f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:15:01.745168 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:01.745666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:01.745747 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:01.764407 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:01.766109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:01.826725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1071/2166] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:01.837362 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:01.838817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:01.901409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eac68b-56e6-4116-98fc-a16e8bb124c2 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:01.905116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60998b1b-e9e1-44e7-b3a4-8880437e96e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:01.905761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998b1b-e9e1-44e7-b3a4-8880437e96e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:01.906044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998b1b-e9e1-44e7-b3a4-8880437e96e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:01.906319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60998b1b-e9e1-44e7-b3a4-8880437e96e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:01.916792 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998b1b-e9e1-44e7-b3a4-8880437e96e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:01.918293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60998b1b-e9e1-44e7-b3a4-8880437e96e7 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:01.928044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1096/2167] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:15:02.232817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:02.236047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:02.264094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d28a67-a790-4dfa-8643-9feff46a3ca6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:02.269491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:02.270425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.270716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.271128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] PATH_INFO: `/v3/projects/f05f4bb8ec2543cc846fc2aa243e9353` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.273092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05f4bb8ec2543cc846fc2aa243e9353)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:02.275657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:02.340153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05f4bb8ec2543cc846fc2aa243e9353', 'request_id': 'req-7ec7f8af-0bb8-4a09-8e95-593902e7b523'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:02.346908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05f4bb8ec2543cc846fc2aa243e9353', 'request_id': 'req-7ec7f8af-0bb8-4a09-8e95-593902e7b523'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:02.356384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05f4bb8ec2543cc846fc2aa243e9353', 'request_id': 'req-7ec7f8af-0bb8-4a09-8e95-593902e7b523'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:02.368669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] The token cache is being invalidate because project f05f4bb8ec2543cc846fc2aa243e9353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:15:02.368959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:02.369600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7ec7f8af-0bb8-4a09-8e95-593902e7b523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:02.371268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1072/2168] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:15:02 2022] DELETE /identity/v3/projects/f05f4bb8ec2543cc846fc2aa243e9353 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:15:02.376731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea7f1-01fa-4c90-9f36-f319e39e553d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.377049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea7f1-01fa-4c90-9f36-f319e39e553d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.377332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ea7f1-01fa-4c90-9f36-f319e39e553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.401660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0d7ea7f1-01fa-4c90-9f36-f319e39e553d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:02.401968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0d7ea7f1-01fa-4c90-9f36-f319e39e553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:02.486643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1097/2169] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:02.495181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e2fd-030e-4188-a477-682666aad3e4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.495632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e2fd-030e-4188-a477-682666aad3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.496077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0e2fd-030e-4188-a477-682666aad3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.518670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cca0e2fd-030e-4188-a477-682666aad3e4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:02.520794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cca0e2fd-030e-4188-a477-682666aad3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:02.534116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1073/2170] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:02.535212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ea7f1-01fa-4c90-9f36-f319e39e553d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:02.560761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ea7f1-01fa-4c90-9f36-f319e39e553d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:02.566019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:02.566911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.567215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.567555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.568569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:15:02.569487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:02.571176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:02.587561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1098/2171] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:15:02.588887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0e2fd-030e-4188-a477-682666aad3e4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:02.603045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0e2fd-030e-4188-a477-682666aad3e4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:02.610192 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:02.610856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.611138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.611674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.612394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:02.614309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:02.642486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1074/2172] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:15:02 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:15:02.647821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:02.660727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2e427-a1d9-409b-baef-7abc76496785 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:02.717771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:02.730587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:02.731277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.731568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.731849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.732597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:02.734541 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:02.758892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1099/2173] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:15:02 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:15:02.762924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:02.777241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b039-58e6-48c3-aca9-cfa7cd3347de admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:02.783034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:02.783847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.784226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.784572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.785388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:02.787076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:02.802871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1075/2174] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:15:02.804534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:02.814830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd823ea-e538-4839-9a95-e946171ec529 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:02.820030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db709ae-cec5-47e4-980d-9db334345a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:02.820754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db709ae-cec5-47e4-980d-9db334345a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.821052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db709ae-cec5-47e4-980d-9db334345a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.821330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db709ae-cec5-47e4-980d-9db334345a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.822058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db709ae-cec5-47e4-980d-9db334345a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:02.823675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db709ae-cec5-47e4-980d-9db334345a2e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:02.837229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1100/2175] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:15:02.841459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:02.852281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3687db-9b3f-44e2-9c3e-5243cc885c74 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:02.857152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:02.858041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.858321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.858815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] PATH_INFO: `/v3/projects/df862b955995466a84bc189d9098d7ce/users/573eab511f4f41b78614247c0f4b99a1/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.885039 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df862b955995466a84bc189d9098d7ce, user_id=573eab511f4f41b78614247c0f4b99a1, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:02.887758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:02.896460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:02.903594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1076/2176] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:15:02 2022] PUT /identity/v3/projects/df862b955995466a84bc189d9098d7ce/users/573eab511f4f41b78614247c0f4b99a1/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:15:02.908641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3ccb-7c66-4e13-b342-72913ff862a1 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:02.908931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3ccb-7c66-4e13-b342-72913ff862a1 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:02.909207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d3ccb-7c66-4e13-b342-72913ff862a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:02.926659 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-829d3ccb-7c66-4e13-b342-72913ff862a1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:02.927866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-829d3ccb-7c66-4e13-b342-72913ff862a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:02.988273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1101/2177] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:02.998281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:03.000053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:03.056112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18fe84-4728-4242-beb1-46b88110b6b0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:03.059838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:03.060532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:03.060930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:03.061323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:03.071055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:03.072641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:03.083650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1077/2178] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:15:08.008096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3e96-fda6-46a0-a302-53f75ee1d90e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:08.008856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3e96-fda6-46a0-a302-53f75ee1d90e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:08.008856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3e96-fda6-46a0-a302-53f75ee1d90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:08.055409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-abbb3e96-fda6-46a0-a302-53f75ee1d90e None None] MFA Rules not processed for user `573eab511f4f41b78614247c0f4b99a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:08.057213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-abbb3e96-fda6-46a0-a302-53f75ee1d90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:08.164713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1102/2179] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:08.169018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:08.180475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323d4f7-5cdf-44a8-a0f5-b6a4f8f65999 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:08.186688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:08.187576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:08.188002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:08.188592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:08.189431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:08.191497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:08.221069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1078/2180] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:15:08 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:15:08.225772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3e96-fda6-46a0-a302-53f75ee1d90e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:08.241984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3e96-fda6-46a0-a302-53f75ee1d90e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:08.314846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:08.315630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:08.316064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:08.316555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:08.317413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:08.320431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:08.327651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:08.347028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1103/2181] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:15:08 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:15:08.351519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:08.362584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aeb11-a853-465b-98d2-4187e634495e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:08.369624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:08.370405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:08.370756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:08.371100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:08.371902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:08.373633 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:08.388864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1079/2182] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:15:08.394035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:08.411546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452087fb-ad9c-4631-9a3d-f8a6910cada3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:08.417606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:08.419063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:08.419063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:08.419263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] PATH_INFO: `/v3/projects/4f0847e6274e4c438dd69a1efca60ee3/users/f8764fe092a94aec8e1da47587940059/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:08.436547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0847e6274e4c438dd69a1efca60ee3, user_id=f8764fe092a94aec8e1da47587940059, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:08.439459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:08.456203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1104/2183] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:15:08 2022] PUT /identity/v3/projects/4f0847e6274e4c438dd69a1efca60ee3/users/f8764fe092a94aec8e1da47587940059/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:15:08.460387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:08.471632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a89868-2c5c-4709-8f4b-b7c41d892b1a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:08.543168 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443001e5-4877-44a3-945c-b1905fbfafd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:08.543921 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443001e5-4877-44a3-945c-b1905fbfafd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:08.544298 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443001e5-4877-44a3-945c-b1905fbfafd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:08.544636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443001e5-4877-44a3-945c-b1905fbfafd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:08.545478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443001e5-4877-44a3-945c-b1905fbfafd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:08.548051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443001e5-4877-44a3-945c-b1905fbfafd4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:08.561980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1080/2184] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:15:08.566366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:08.577992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d24b6-7f59-4769-8dc1-2f5702bc4622 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:08.583592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:08.585178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:08.585308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:08.585724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] PATH_INFO: `/v3/projects/4f0847e6274e4c438dd69a1efca60ee3/users/f8764fe092a94aec8e1da47587940059/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:08.587796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0847e6274e4c438dd69a1efca60ee3, user_id=f8764fe092a94aec8e1da47587940059, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:08.590489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:08.610089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1105/2185] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:15:08 2022] PUT /identity/v3/projects/4f0847e6274e4c438dd69a1efca60ee3/users/f8764fe092a94aec8e1da47587940059/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:15:14.026414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816f0b-5d41-41ca-b76e-304b4b12937f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:14.027000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816f0b-5d41-41ca-b76e-304b4b12937f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:14.027000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6816f0b-5d41-41ca-b76e-304b4b12937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:14.071084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f6816f0b-5d41-41ca-b76e-304b4b12937f None None] MFA Rules not processed for user `f8764fe092a94aec8e1da47587940059`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:14.072858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f6816f0b-5d41-41ca-b76e-304b4b12937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:14.126032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:14.207356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1081/2186] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:14.219846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:14.221682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:14.307187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d968b-bafc-43ea-a1ca-cacf4c9a7998 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:14.311612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd5a266491c487385349368b5ccbbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:14.312683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:14.312683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:14.312900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:14.373035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:14.374584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:14.386136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1106/2187] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:15:14.526401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6157-1db1-46e5-be9a-fac2e5ca4f63 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:14.526766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6157-1db1-46e5-be9a-fac2e5ca4f63 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:14.527155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0f6157-1db1-46e5-be9a-fac2e5ca4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:14.546259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8f0f6157-1db1-46e5-be9a-fac2e5ca4f63 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:14.547486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8f0f6157-1db1-46e5-be9a-fac2e5ca4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:14.614659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1082/2188] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:15:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:14.661309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:14.663434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:14.720156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:14.745720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffa064-05f0-498e-960a-70f3bc3370e5 service glance] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:14.750782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea75d70-b75e-4098-ad3c-f02d35a2450c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:14.751436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea75d70-b75e-4098-ad3c-f02d35a2450c service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:14.751721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea75d70-b75e-4098-ad3c-f02d35a2450c service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:14.751999 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea75d70-b75e-4098-ad3c-f02d35a2450c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:14.762080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea75d70-b75e-4098-ad3c-f02d35a2450c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:14.763684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea75d70-b75e-4098-ad3c-f02d35a2450c service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:14.772779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1107/2189] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:15:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:15:19.666600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bef60-20b4-436a-9735-3c2e374dd273 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:19.667487 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bef60-20b4-436a-9735-3c2e374dd273 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:19.667838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bef60-20b4-436a-9735-3c2e374dd273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:19.699849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-126bef60-20b4-436a-9735-3c2e374dd273 None None] MFA Rules not processed for user `2cb12a51b62c48ba95be62f167b7314e`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:19.703046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-126bef60-20b4-436a-9735-3c2e374dd273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:19.800848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1083/2190] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:24.769457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=11 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:26.212613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74bbd-114c-491d-86f9-dd60fa6b4d65 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:26.213284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74bbd-114c-491d-86f9-dd60fa6b4d65 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:26.213284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c74bbd-114c-491d-86f9-dd60fa6b4d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:26.232199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a2c74bbd-114c-491d-86f9-dd60fa6b4d65 None None] MFA Rules not processed for user `573eab511f4f41b78614247c0f4b99a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:26.233435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a2c74bbd-114c-491d-86f9-dd60fa6b4d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:26.242543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1108/2191] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:29.784653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=70 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:33.798566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966239-2e31-493a-86b7-e1b6c542d5c9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:33.799165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966239-2e31-493a-86b7-e1b6c542d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:33.799165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2966239-2e31-493a-86b7-e1b6c542d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:33.828193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d2966239-2e31-493a-86b7-e1b6c542d5c9 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:33.829450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d2966239-2e31-493a-86b7-e1b6c542d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:33.852047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1084/2192] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:33.864566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74bbd-114c-491d-86f9-dd60fa6b4d65 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:33.877874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c74bbd-114c-491d-86f9-dd60fa6b4d65 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:33.884684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:33.885341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:33.885631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:33.885913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:33.894904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:33.896643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:33.905664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1109/2193] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:15:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:15:34.242319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:34.242617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:34.243080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:34.285347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:34.286603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:34.302852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1085/2194] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:15:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:34.346130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:34.367281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e8985-2665-445d-ae6e-e67a5a113b5e service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:34.381100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ea811-b8d4-4037-8ba6-4f4cc897117d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:34.381946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea811-b8d4-4037-8ba6-4f4cc897117d service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:34.382197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea811-b8d4-4037-8ba6-4f4cc897117d service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:34.382459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ea811-b8d4-4037-8ba6-4f4cc897117d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:34.394157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ea811-b8d4-4037-8ba6-4f4cc897117d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:34.395654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ea811-b8d4-4037-8ba6-4f4cc897117d service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:34.421281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1110/2195] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:15:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:15:35.020670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:35.024687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:35.226067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783681b-6f6b-475c-96eb-4a9daaf4ee0b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:35.232494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:35.233563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:35.234210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:35.234879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] PATH_INFO: `/v3/users/090b11c58a8b40dc9dbaf934a33bddc6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:35.236624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=090b11c58a8b40dc9dbaf934a33bddc6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:35.239088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:35.310831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '090b11c58a8b40dc9dbaf934a33bddc6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:35.311760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '090b11c58a8b40dc9dbaf934a33bddc6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:35.312703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '090b11c58a8b40dc9dbaf934a33bddc6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:35.329488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '090b11c58a8b40dc9dbaf934a33bddc6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:35.343439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '090b11c58a8b40dc9dbaf934a33bddc6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:35.375838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1086/2196] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:15:35 2022] DELETE /identity/v3/users/090b11c58a8b40dc9dbaf934a33bddc6 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:15:35.380343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:35.380874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:35.381695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:35.440538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:15:35.442168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:35.576693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1111/2197] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:15:35.587176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:35.588938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:35.663787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:35.789115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd3bcf-2717-4087-b1c6-ff71c08e5a06 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:35.793727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:35.794818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:35.795437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:35.796038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:35.809347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:35.811682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:35.825071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1087/2198] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:15:36.425955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:15:36.431253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:15:36.457732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5139d0-2a12-44ef-9579-7ba1baf8a9c0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:15:36.483329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:15:36.487192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:15:36.488753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:15:36.491027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] PATH_INFO: `/v3/projects/a7bda3fc37c64addabced03e2e92eb50` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:15:36.496824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7bda3fc37c64addabced03e2e92eb50)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:15:36.505066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:15:36.605640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7bda3fc37c64addabced03e2e92eb50', 'request_id': 'req-eb532377-5c38-49cd-a96e-ba91acd59cfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:36.616725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7bda3fc37c64addabced03e2e92eb50', 'request_id': 'req-eb532377-5c38-49cd-a96e-ba91acd59cfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:36.666111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7bda3fc37c64addabced03e2e92eb50', 'request_id': 'req-eb532377-5c38-49cd-a96e-ba91acd59cfd'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:36.734756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] The token cache is being invalidate because project a7bda3fc37c64addabced03e2e92eb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:15:36.735041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:36.735963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eb532377-5c38-49cd-a96e-ba91acd59cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:15:36.778742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1112/2199] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:15:36 2022] DELETE /identity/v3/projects/a7bda3fc37c64addabced03e2e92eb50 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:15:45.819803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=25 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:15:46.729332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:01.947800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:16:01.949534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:02.050812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19f2c-25a0-4a45-982c-7b28458a118d service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:16:02.117461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622c9ad-9a5b-4cda-b82a-ae7ebecd14fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:16:02.117964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c9ad-9a5b-4cda-b82a-ae7ebecd14fd service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:02.118319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c9ad-9a5b-4cda-b82a-ae7ebecd14fd service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:02.118662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622c9ad-9a5b-4cda-b82a-ae7ebecd14fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:02.120663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1622c9ad-9a5b-4cda-b82a-ae7ebecd14fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:02.134797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c9ad-9a5b-4cda-b82a-ae7ebecd14fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:16:02.136450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622c9ad-9a5b-4cda-b82a-ae7ebecd14fd service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:16:02.148432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1088/2200] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:16:03.251225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9612ae-64b6-417a-adcb-e721d3275bd4 None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.252200 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9612ae-64b6-417a-adcb-e721d3275bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.252483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9612ae-64b6-417a-adcb-e721d3275bd4 None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.253969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1113/2201] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:16:03.265490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e76e14-446d-4521-8f43-9068c6e05be4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.266032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e76e14-446d-4521-8f43-9068c6e05be4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.266140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e76e14-446d-4521-8f43-9068c6e05be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.328669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-63e76e14-446d-4521-8f43-9068c6e05be4 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:16:03.329898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-63e76e14-446d-4521-8f43-9068c6e05be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:03.370764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:03.420274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1089/2202] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:16:03.433237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9612ae-64b6-417a-adcb-e721d3275bd4 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:16:03.435106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9e9612ae-64b6-417a-adcb-e721d3275bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:03.516854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9612ae-64b6-417a-adcb-e721d3275bd4 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:16:03.520482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9fda8-0681-4eb8-b9be-4c10f801621b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd5a266491c487385349368b5ccbbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:16:03.521124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9fda8-0681-4eb8-b9be-4c10f801621b service glance] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.521408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9fda8-0681-4eb8-b9be-4c10f801621b service glance] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.522670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9fda8-0681-4eb8-b9be-4c10f801621b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.532774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9fda8-0681-4eb8-b9be-4c10f801621b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:16:03.534201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9fda8-0681-4eb8-b9be-4c10f801621b service glance] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:16:03.546148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1114/2203] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:16:03.620165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fffcf4-d046-4ca3-bde1-ff08e2fad4a7 None None] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.620818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fffcf4-d046-4ca3-bde1-ff08e2fad4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.621099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fffcf4-d046-4ca3-bde1-ff08e2fad4a7 None None] PATH_INFO: `/` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.622637 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1090/2204] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:16:03.627466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8736f4-1b5a-4ff5-9f11-6f9c2b6a5848 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.627786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8736f4-1b5a-4ff5-9f11-6f9c2b6a5848 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.628072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8736f4-1b5a-4ff5-9f11-6f9c2b6a5848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.647603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3b8736f4-1b5a-4ff5-9f11-6f9c2b6a5848 None None] MFA Rules not processed for user `d9ea56567eeb4392b5f9e5c84f16f413`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:16:03.648966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3b8736f4-1b5a-4ff5-9f11-6f9c2b6a5848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:03.702191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1115/2205] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:16:03.714318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fffcf4-d046-4ca3-bde1-ff08e2fad4a7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:16:03.716023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c4fffcf4-d046-4ca3-bde1-ff08e2fad4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:03.733731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fffcf4-d046-4ca3-bde1-ff08e2fad4a7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:16:03.737203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c192abd-adb8-4919-a6c1-30cebae74d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:16:03.737840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c192abd-adb8-4919-a6c1-30cebae74d13 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.738379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c192abd-adb8-4919-a6c1-30cebae74d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.738649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c192abd-adb8-4919-a6c1-30cebae74d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.746965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c192abd-adb8-4919-a6c1-30cebae74d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:16:03.748471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c192abd-adb8-4919-a6c1-30cebae74d13 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:16:03.756194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1091/2206] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:16:03.840937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf819-2062-4932-9181-73b4dd4e3b6e None None] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.841254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf819-2062-4932-9181-73b4dd4e3b6e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.841530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf819-2062-4932-9181-73b4dd4e3b6e None None] PATH_INFO: `/` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.842928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1116/2207] 10.222.0.43 () {54 vars in 921 bytes} [Thu Jun 16 21:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 21:16:03.848342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54664-7243-4227-a1ec-6291d1187eb6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.848636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54664-7243-4227-a1ec-6291d1187eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.848918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d54664-7243-4227-a1ec-6291d1187eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.868693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-18d54664-7243-4227-a1ec-6291d1187eb6 None None] MFA Rules not processed for user `c1e4d798757a41cfad3454940c12bcab`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:16:03.869900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-18d54664-7243-4227-a1ec-6291d1187eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:03.879406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1092/2208] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Jun 16 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:16:03.890848 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf819-2062-4932-9181-73b4dd4e3b6e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:16:03.892963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-af0cf819-2062-4932-9181-73b4dd4e3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:03.906952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf819-2062-4932-9181-73b4dd4e3b6e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:16:03.910480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d78fc-3593-4166-b111-6829afac5d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:16:03.911115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d78fc-3593-4166-b111-6829afac5d05 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:03.911399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d78fc-3593-4166-b111-6829afac5d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:03.911676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d78fc-3593-4166-b111-6829afac5d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:03.922429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d78fc-3593-4166-b111-6829afac5d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:16:03.923844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d78fc-3593-4166-b111-6829afac5d05 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:16:03.935356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1117/2209] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:16:11.532618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:11.533269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:11.533269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:11.553220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] MFA Rules not processed for user `2d1d69a29709455d9d9dc596ecbb870d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:16:11.555472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:11.625384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1093/2210] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:16:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:16:12.749189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc70d9-d5f1-4430-9ef8-c2a7878e3c5f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:12.749679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc70d9-d5f1-4430-9ef8-c2a7878e3c5f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:12.749773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc70d9-d5f1-4430-9ef8-c2a7878e3c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:12.827567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2dbc70d9-d5f1-4430-9ef8-c2a7878e3c5f None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:16:12.829114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2dbc70d9-d5f1-4430-9ef8-c2a7878e3c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:12.893084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:12.952899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1118/2211] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:16:12.971200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:16:12.973443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:13.090725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d7026-94d3-47b2-92e0-b3389438e3d2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:16:13.096447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2747f-f99d-4f94-a7e4-d11eaeb093bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:16:13.097357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2747f-f99d-4f94-a7e4-d11eaeb093bf service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:13.097835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2747f-f99d-4f94-a7e4-d11eaeb093bf service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:13.098425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2747f-f99d-4f94-a7e4-d11eaeb093bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:13.111763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2747f-f99d-4f94-a7e4-d11eaeb093bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:16:13.114937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2747f-f99d-4f94-a7e4-d11eaeb093bf service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:16:13.127646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1094/2212] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:16:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:16:22.935193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:23.122295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:34.709770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc70d9-d5f1-4430-9ef8-c2a7878e3c5f None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:16:34.719877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc70d9-d5f1-4430-9ef8-c2a7878e3c5f None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:16:34.723529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:16:34.724151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:34.724467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:34.724745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:34.726514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:34.790118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:16:34.791479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:16:34.800867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1119/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:16:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:16:38.413904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac169-588f-4c83-8702-8a4a2b2f5910 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:38.415245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac169-588f-4c83-8702-8a4a2b2f5910 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:38.415786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ac169-588f-4c83-8702-8a4a2b2f5910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:38.438069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-127ac169-588f-4c83-8702-8a4a2b2f5910 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:16:38.439409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-127ac169-588f-4c83-8702-8a4a2b2f5910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:38.448650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1095/2214] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 16 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:16:38.481895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:16:38.495528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1975fe-af7b-45da-b925-5a9ff2f09ef8 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:16:38.501019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64c42b-77ba-460c-9819-7218419ae90f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:16:38.501979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64c42b-77ba-460c-9819-7218419ae90f service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:38.502339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64c42b-77ba-460c-9819-7218419ae90f service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:38.502705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64c42b-77ba-460c-9819-7218419ae90f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:38.512385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64c42b-77ba-460c-9819-7218419ae90f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:16:38.513998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64c42b-77ba-460c-9819-7218419ae90f service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:16:38.523226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1120/2215] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:16:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:16:38.859372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:16:38.859675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:16:38.859956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:16:38.888704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] MFA Rules not processed for user `1d410832e6584828875128e31baa0ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:16:38.890109 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:16:39.000411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1096/2216] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:16:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:16:48.519707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=36 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:16:48.987224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=28 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:15.656561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709b1b4-8d44-4e7a-b5dd-b650be9c706b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:15.657337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709b1b4-8d44-4e7a-b5dd-b650be9c706b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:15.657337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709b1b4-8d44-4e7a-b5dd-b650be9c706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:15.674326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8709b1b4-8d44-4e7a-b5dd-b650be9c706b None None] MFA Rules not processed for user `2cb12a51b62c48ba95be62f167b7314e`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:17:15.675536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8709b1b4-8d44-4e7a-b5dd-b650be9c706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:15.730471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1121/2217] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:17:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:17:25.723147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=25 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:36.835797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:36.837316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:36.907650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d7303-7fab-426c-a1b0-d6352268c4d2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:36.912122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:36.913017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:36.913293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:36.913566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] PATH_INFO: `/v3/users/2d1d69a29709455d9d9dc596ecbb870d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:36.914756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1d69a29709455d9d9dc596ecbb870d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:36.916717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:36.961070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1d69a29709455d9d9dc596ecbb870d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:36.961711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1d69a29709455d9d9dc596ecbb870d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:36.962307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1d69a29709455d9d9dc596ecbb870d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:36.974191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1d69a29709455d9d9dc596ecbb870d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:36.981253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-519b355e-993e-4830-a32d-ed8052a4d094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1d69a29709455d9d9dc596ecbb870d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:36.993594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1097/2218] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:17:36 2022] DELETE /identity/v3/users/2d1d69a29709455d9d9dc596ecbb870d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:17:37.174588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709b1b4-8d44-4e7a-b5dd-b650be9c706b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.186039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709b1b4-8d44-4e7a-b5dd-b650be9c706b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:37.260433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:37.261307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.261593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.261869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] PATH_INFO: `/v3/projects/0a667c6d13514cc4bdaaf4598bc723d4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.263063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a667c6d13514cc4bdaaf4598bc723d4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:37.265014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:37.311025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a667c6d13514cc4bdaaf4598bc723d4', 'request_id': 'req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:37.319017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a667c6d13514cc4bdaaf4598bc723d4', 'request_id': 'req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:37.326316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a667c6d13514cc4bdaaf4598bc723d4', 'request_id': 'req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:37.339123 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] The token cache is being invalidate because project 0a667c6d13514cc4bdaaf4598bc723d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:17:37.339411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:37.340061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-095cc00d-ec6d-48d8-bc58-3b9284b2ec31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:37.341660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1122/2219] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:17:37 2022] DELETE /identity/v3/projects/0a667c6d13514cc4bdaaf4598bc723d4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:17:37.346733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b8aa-e998-4ab5-9ae2-137d889a28aa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.347022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b8aa-e998-4ab5-9ae2-137d889a28aa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.347361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d981b8aa-e998-4ab5-9ae2-137d889a28aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.385872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d981b8aa-e998-4ab5-9ae2-137d889a28aa None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:17:37.387162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d981b8aa-e998-4ab5-9ae2-137d889a28aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:37.448243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1098/2220] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:17:37.456101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f561-ec63-43ea-bd10-c9929765240d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.456424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f561-ec63-43ea-bd10-c9929765240d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.456705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6f561-ec63-43ea-bd10-c9929765240d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.475292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7da6f561-ec63-43ea-bd10-c9929765240d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:17:37.476470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7da6f561-ec63-43ea-bd10-c9929765240d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:37.484992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1123/2221] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:17:37.489317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b8aa-e998-4ab5-9ae2-137d889a28aa None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.496058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:37.500414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d981b8aa-e998-4ab5-9ae2-137d889a28aa None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:37.506916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:37.507595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.508191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.508660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.509387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:17:37.509694 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:37.511323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:37.523041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1099/2222] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:17:37.527395 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f561-ec63-43ea-bd10-c9929765240d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.537137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6f561-ec63-43ea-bd10-c9929765240d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:37.542155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:37.542818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.543106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.543380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.544095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:37.546033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:37.572325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1124/2223] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:17:37 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:17:37.576411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.587035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ac506-e261-42a2-9637-f27ab8e54992 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:37.642446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:37.643144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.643422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.643697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.644412 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:37.646317 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:37.666036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1100/2224] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:17:37 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:17:37.670035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.680271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce610b03-12eb-4a32-8228-2e59f5850b5e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:37.684817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:37.685464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.685743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.686017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.686731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:37.688914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:37.700510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1125/2225] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:17:37.705583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.716148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a4980-94c7-4f03-acb8-1276e975b415 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:37.721625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5849-2f09-408a-b65d-af8b46ba28aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:37.722292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5849-2f09-408a-b65d-af8b46ba28aa admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.722577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5849-2f09-408a-b65d-af8b46ba28aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.722856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5849-2f09-408a-b65d-af8b46ba28aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.723619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5849-2f09-408a-b65d-af8b46ba28aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:37.725258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f5849-2f09-408a-b65d-af8b46ba28aa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:37.736136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1101/2226] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:17:37.741051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.751425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad1415-711e-4583-9f28-4073023b62b4 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:37.756280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:37.757159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.757438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.757706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] PATH_INFO: `/v3/projects/122c593df1b5430183ca2d750b78fa2d/users/b6c31333e8d34c9d8e7ecccb718ff48c/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.773014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=122c593df1b5430183ca2d750b78fa2d, user_id=b6c31333e8d34c9d8e7ecccb718ff48c, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:37.775754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:37.788552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1126/2227] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:17:37 2022] PUT /identity/v3/projects/122c593df1b5430183ca2d750b78fa2d/users/b6c31333e8d34c9d8e7ecccb718ff48c/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:17:37.799421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52fac-971d-413d-966a-c0d78f39b6fa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:37.799715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52fac-971d-413d-966a-c0d78f39b6fa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:37.799995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c52fac-971d-413d-966a-c0d78f39b6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:37.827640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-03c52fac-971d-413d-966a-c0d78f39b6fa None None] MFA Rules not processed for user `b6c31333e8d34c9d8e7ecccb718ff48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:17:37.829644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-03c52fac-971d-413d-966a-c0d78f39b6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:37.897192 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1102/2228] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:17:37.908494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:37.910547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:37.948432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:38.018679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01226b5-a6d1-416e-bb17-9d57a4531831 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:38.022506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79aa413-20c7-459d-bd81-053dd9b4d206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:38.023157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aa413-20c7-459d-bd81-053dd9b4d206 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:38.023445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aa413-20c7-459d-bd81-053dd9b4d206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:38.023777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79aa413-20c7-459d-bd81-053dd9b4d206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:38.033102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aa413-20c7-459d-bd81-053dd9b4d206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:38.034542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79aa413-20c7-459d-bd81-053dd9b4d206 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:38.043534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1127/2229] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:17:47.893342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:48.039403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=23 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:56.554674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52fac-971d-413d-966a-c0d78f39b6fa None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:56.626893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c52fac-971d-413d-966a-c0d78f39b6fa None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:56.631338 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:56.632229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:56.632513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:56.632782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] PATH_INFO: `/v3/users/b6c31333e8d34c9d8e7ecccb718ff48c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:56.633963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c31333e8d34c9d8e7ecccb718ff48c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:56.635886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:56.687242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c31333e8d34c9d8e7ecccb718ff48c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:56.687904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c31333e8d34c9d8e7ecccb718ff48c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:56.689090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c31333e8d34c9d8e7ecccb718ff48c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:56.702189 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c31333e8d34c9d8e7ecccb718ff48c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:56.710169 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c31333e8d34c9d8e7ecccb718ff48c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:56.724728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1103/2230] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:17:56 2022] DELETE /identity/v3/users/b6c31333e8d34c9d8e7ecccb718ff48c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:17:56.730488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc7cc-6ad3-43d6-854c-3f4bbb83e5a5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:56.730998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc7cc-6ad3-43d6-854c-3f4bbb83e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:56.731099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddc7cc-6ad3-43d6-854c-3f4bbb83e5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:56.749819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6dddc7cc-6ad3-43d6-854c-3f4bbb83e5a5 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:17:56.751708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6dddc7cc-6ad3-43d6-854c-3f4bbb83e5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:56.815873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1128/2231] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:17:56.825331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:56.826730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:56.887301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf0a1f-fdf4-4c9d-89dd-565c7ce982da admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:56.890945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:56.891639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:56.891997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:56.892394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:56.901683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:56.903121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:56.914095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1104/2232] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:17:57.125497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddc7cc-6ad3-43d6-854c-3f4bbb83e5a5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:57.140748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddc7cc-6ad3-43d6-854c-3f4bbb83e5a5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:57.154630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2117d3-0e1b-495f-b753-7dc4362aa5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:57.158192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2117d3-0e1b-495f-b753-7dc4362aa5aa service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:57.159230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2117d3-0e1b-495f-b753-7dc4362aa5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:57.159532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2117d3-0e1b-495f-b753-7dc4362aa5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:57.162072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7c2117d3-0e1b-495f-b753-7dc4362aa5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:57.227192 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:57.228750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:57.254721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed87fa8-f78b-4334-b1f5-87bd8b7af54b service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:57.264029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:57.264964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:57.265246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:57.265514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] PATH_INFO: `/v3/projects/122c593df1b5430183ca2d750b78fa2d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:57.269685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=122c593df1b5430183ca2d750b78fa2d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:57.271602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:57.291075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:17:57.291971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2117d3-0e1b-495f-b753-7dc4362aa5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:57.293882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2117d3-0e1b-495f-b753-7dc4362aa5aa service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:57.315733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1129/2233] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:17:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:17:57.335238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122c593df1b5430183ca2d750b78fa2d', 'request_id': 'req-92d6a072-e9e9-4006-8deb-cd3e31f32a66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:57.342184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122c593df1b5430183ca2d750b78fa2d', 'request_id': 'req-92d6a072-e9e9-4006-8deb-cd3e31f32a66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:57.352592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122c593df1b5430183ca2d750b78fa2d', 'request_id': 'req-92d6a072-e9e9-4006-8deb-cd3e31f32a66'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:57.371345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] The token cache is being invalidate because project 122c593df1b5430183ca2d750b78fa2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:17:57.371689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:57.372400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:17:57.374459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1105/2234] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:17:57 2022] DELETE /identity/v3/projects/122c593df1b5430183ca2d750b78fa2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:17:58.385937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:58.386456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:58.386555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:58.405445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] MFA Rules not processed for user `8cc395fc4407473e9595bc99c6b6b36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:17:58.406645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:58.460682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1130/2235] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:17:58.516157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:17:58.518618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:58.582696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6a072-e9e9-4006-8deb-cd3e31f32a66 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:17:58.586335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:17:58.586982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:17:58.587266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:17:58.587541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:17:58.589347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:17:58.666981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:17:58.667956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:17:58.679561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1106/2236] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:08.453505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=86 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:08.674620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:09.826399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:09.827823 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:09.843610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef82575-23b4-46d3-9211-df12654675ad None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:09.850860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a31ebd-cf03-4efa-834a-ab00437711dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:09.851621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31ebd-cf03-4efa-834a-ab00437711dd service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:09.851910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31ebd-cf03-4efa-834a-ab00437711dd service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:09.852204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a31ebd-cf03-4efa-834a-ab00437711dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:09.854002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-22a31ebd-cf03-4efa-834a-ab00437711dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:09.865881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a31ebd-cf03-4efa-834a-ab00437711dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:09.867739 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a31ebd-cf03-4efa-834a-ab00437711dd service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:09.877122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1131/2237] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:14.309973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:14.311501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:14.326433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27962e0-8e8f-41cb-8c81-188e09c3c768 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:14.333828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:14.334483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:14.334890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:14.335027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:14.336864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:14.395556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:14.397175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:14.406241 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1107/2238] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:19.872757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=6 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:24.402030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=28 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:31.734566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:31.735089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:31.735192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:31.754295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] MFA Rules not processed for user `2cb12a51b62c48ba95be62f167b7314e`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:18:31.755486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:31.762568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1132/2239] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:18:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:18:32.065839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:32.067246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:32.078724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca459e5-ff07-4dcb-8ed0-86a2517cd3fc service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:32.083071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:32.083721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:32.084005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:32.084316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:32.086066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:32.095695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:32.097931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:32.106100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1108/2240] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:32.419113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:32.420567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:32.490808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722dc4-6a8a-4130-9544-d39d1a78441c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:32.495986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05901037-2116-43e2-bb08-10d0f5420cfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:32.496665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05901037-2116-43e2-bb08-10d0f5420cfa service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:32.496952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05901037-2116-43e2-bb08-10d0f5420cfa service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:32.497233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05901037-2116-43e2-bb08-10d0f5420cfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:32.499000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-05901037-2116-43e2-bb08-10d0f5420cfa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:32.510918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05901037-2116-43e2-bb08-10d0f5420cfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:32.512519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05901037-2116-43e2-bb08-10d0f5420cfa service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:32.522913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1133/2241] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:33.404575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:33.415849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049be0a-36bc-4dc3-a44f-8ad81f5eb116 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:33.420318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:33.420804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:33.421083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:33.421356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:33.423328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:33.433230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:33.434675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:33.444395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1109/2242] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:35.774277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:35.774785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:35.774884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:35.794549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] MFA Rules not processed for user `1d410832e6584828875128e31baa0ae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:18:35.796052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:35.865248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1134/2243] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:18:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:18:36.571146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:36.598148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52090c83-70b8-4027-9b05-8ac3f585c9e5 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:36.618737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:36.619952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:36.620413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:36.620837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:36.623801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:36.641858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:36.644686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:36.673136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1110/2244] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:43.191700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:43.193525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:43.259131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af817c4e-d820-4fa3-9b80-7568f7e931d3 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:43.264229 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289a1ab-91a7-4fa3-8f25-71e1ea554b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:43.265022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289a1ab-91a7-4fa3-8f25-71e1ea554b06 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:43.265409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289a1ab-91a7-4fa3-8f25-71e1ea554b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:43.265789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289a1ab-91a7-4fa3-8f25-71e1ea554b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:43.267749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5289a1ab-91a7-4fa3-8f25-71e1ea554b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:43.347020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:43.369469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289a1ab-91a7-4fa3-8f25-71e1ea554b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:43.371071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289a1ab-91a7-4fa3-8f25-71e1ea554b06 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:43.383528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1135/2245] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:46.653701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=18 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:48.013322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:48.025967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162a6c-aa29-41c3-a0f6-924158cf8e1c service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:48.032789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:48.033458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:48.033791 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:48.034071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:48.036389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:48.050686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:48.052380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:48.064042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1111/2246] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:49.639316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ea37-26a9-4140-9ad9-74bd334dac14 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:49.639928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ea37-26a9-4140-9ad9-74bd334dac14 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:49.639928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5ea37-26a9-4140-9ad9-74bd334dac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:49.660280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7dc5ea37-26a9-4140-9ad9-74bd334dac14 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:18:49.661510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7dc5ea37-26a9-4140-9ad9-74bd334dac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:49.764209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1136/2247] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 16 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:18:49.842395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:49.844552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:49.952646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23623b-e8f3-4b96-8f08-ea7bad98cbf5 service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:49.958419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:49.959343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:49.959780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:49.960244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:49.969173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:49.970972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:49.982067 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1112/2248] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:18:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:18:52.009023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637598b-0927-40e6-89fd-7efa6591820a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:52.009537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637598b-0927-40e6-89fd-7efa6591820a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:52.009638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637598b-0927-40e6-89fd-7efa6591820a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:52.029443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9637598b-0927-40e6-89fd-7efa6591820a None None] MFA Rules not processed for user `9c13ce02fca548c5b1186a536a2d4474`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:18:52.030693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9637598b-0927-40e6-89fd-7efa6591820a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:52.039271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1137/2249] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:18:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:18:52.476744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:52.488403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589d397-d991-41fb-8813-6c5747fce6f5 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:52.493006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:52.493938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:52.494217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:52.494661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:52.496613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:52.508382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:52.509853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:52.520357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1113/2250] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:54.437383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637598b-0927-40e6-89fd-7efa6591820a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:54.452785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637598b-0927-40e6-89fd-7efa6591820a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:54.458099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:54.458759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:54.459048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:54.459329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:54.461198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:54.475590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:54.478434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:54.496236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1138/2251] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:18:58.151080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:58.166662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848595a-4652-47fc-975f-b020696af0c8 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:58.172476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:58.173131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:58.173417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:58.173693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:58.175931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:58.189223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:58.191610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:58.202989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1114/2252] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:18:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:18:58.226092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:58.228779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:58.303637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad56f6-c1f6-44ec-b96c-8602867b9031 service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:58.308327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:58.309194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:58.309472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:58.309755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] PATH_INFO: `/v3/users/573eab511f4f41b78614247c0f4b99a1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:58.310908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573eab511f4f41b78614247c0f4b99a1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:58.312955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:58.358663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573eab511f4f41b78614247c0f4b99a1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.359324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573eab511f4f41b78614247c0f4b99a1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.359937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573eab511f4f41b78614247c0f4b99a1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.373185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573eab511f4f41b78614247c0f4b99a1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.376670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:58.381065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573eab511f4f41b78614247c0f4b99a1'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.394975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1139/2253] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:18:58 2022] DELETE /identity/v3/users/573eab511f4f41b78614247c0f4b99a1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:18:58.573892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:58.584851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3033c5-dbf1-4a40-a443-2e4103006ba7 service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:58.647337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:58.648212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:58.648499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:58.648773 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] PATH_INFO: `/v3/projects/df862b955995466a84bc189d9098d7ce` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:58.649946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] RBAC: Authorizing `identity:delete_project(project_id=df862b955995466a84bc189d9098d7ce)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:58.651888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:58.697063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df862b955995466a84bc189d9098d7ce', 'request_id': 'req-39adea2a-c5af-402d-85a4-df5c81c0a25c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.698814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:18:58.704553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df862b955995466a84bc189d9098d7ce', 'request_id': 'req-39adea2a-c5af-402d-85a4-df5c81c0a25c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.712493 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df862b955995466a84bc189d9098d7ce', 'request_id': 'req-39adea2a-c5af-402d-85a4-df5c81c0a25c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.723267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] The token cache is being invalidate because project df862b955995466a84bc189d9098d7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:18:58.723786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.724495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.726040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1115/2254] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:18:58 2022] DELETE /identity/v3/projects/df862b955995466a84bc189d9098d7ce => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:18:58.730194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:58.731637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:58.745453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318c5d9-fce1-4cb5-94cb-c79ad229ae69 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:58.801860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:58.802898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:58.803213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:58.803490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] PATH_INFO: `/v3/users/f8764fe092a94aec8e1da47587940059` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:58.804720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8764fe092a94aec8e1da47587940059)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:58.806688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:58.855681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8764fe092a94aec8e1da47587940059'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.856391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8764fe092a94aec8e1da47587940059'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.857011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8764fe092a94aec8e1da47587940059'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.873370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8764fe092a94aec8e1da47587940059'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.887186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8764fe092a94aec8e1da47587940059'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:58.900720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1140/2255] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:18:58 2022] DELETE /identity/v3/users/f8764fe092a94aec8e1da47587940059 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:18:59.108916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:18:59.110345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:18:59.124553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adea2a-c5af-402d-85a4-df5c81c0a25c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:18:59.187550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:18:59.188480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:18:59.188794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:18:59.189076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] PATH_INFO: `/v3/projects/4f0847e6274e4c438dd69a1efca60ee3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:18:59.190915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0847e6274e4c438dd69a1efca60ee3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:18:59.192910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:18:59.239636 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0847e6274e4c438dd69a1efca60ee3', 'request_id': 'req-37679000-5c24-4d6d-93b0-8855a7cd8c96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:59.245927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0847e6274e4c438dd69a1efca60ee3', 'request_id': 'req-37679000-5c24-4d6d-93b0-8855a7cd8c96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:59.254309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0847e6274e4c438dd69a1efca60ee3', 'request_id': 'req-37679000-5c24-4d6d-93b0-8855a7cd8c96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:59.265223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] The token cache is being invalidate because project 4f0847e6274e4c438dd69a1efca60ee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:18:59.265509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:59.266149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-37679000-5c24-4d6d-93b0-8855a7cd8c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:18:59.267683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1116/2256] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:18:59 2022] DELETE /identity/v3/projects/4f0847e6274e4c438dd69a1efca60ee3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:19:01.448047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:01.449586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:01.525469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:01.530073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c742062-8086-4a2c-91cb-0e5b3f14ea89 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:01.602170 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:01.602780 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:01.603134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:01.603449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:01.605358 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:01.619476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:01.621128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:01.631954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1141/2257] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:19:09.262015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:11.627084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=32 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:18.554555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:18.555045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:18.555147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:18.573802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:19:18.575013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:18.630966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1117/2258] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:19:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:19:18.643036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:18.644510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:18.714663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d14a9-34b8-4445-9e4a-15cf1c389e7e service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:18.719826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:18.720517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:18.720803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:18.721078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:18.729447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:18.731024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:18.739957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1142/2259] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:19:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 21:19:28.623565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=25 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:28.735815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=32 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:34.840620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:34.842227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:34.909700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378d40e-be18-4808-83ba-191c96b1efd2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:34.913311 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94510d9-57f3-42aa-b480-676b64170336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:34.913947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94510d9-57f3-42aa-b480-676b64170336 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:34.914225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94510d9-57f3-42aa-b480-676b64170336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:34.914496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94510d9-57f3-42aa-b480-676b64170336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:34.916257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e94510d9-57f3-42aa-b480-676b64170336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:34.974564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94510d9-57f3-42aa-b480-676b64170336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:34.976269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94510d9-57f3-42aa-b480-676b64170336 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:34.985276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1118/2260] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:19:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:19:35.800117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:35.801648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:35.817784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7cd3c-7fc2-414f-aa1f-68d82480c808 service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:35.825062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:35.825550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:35.825838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:35.826112 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:35.829157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:35.896758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:35.898378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:35.908683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1143/2261] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:19:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:19:37.815331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf407-b0f0-4545-bb8e-a5727e7b1482 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:37.815859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf407-b0f0-4545-bb8e-a5727e7b1482 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:37.815968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcf407-b0f0-4545-bb8e-a5727e7b1482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:37.835642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-88bcf407-b0f0-4545-bb8e-a5727e7b1482 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:19:37.837198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-88bcf407-b0f0-4545-bb8e-a5727e7b1482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:37.851875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1119/2262] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:19:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:19:37.865736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:37.878080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787a109-d9fe-49e4-a6e2-acd44f1f375f service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:37.884116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:37.885138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:37.885138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:37.885944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:37.895913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:37.898102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:37.906876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1144/2263] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:19:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:19:47.830003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=51 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:47.903485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=34 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:52.830271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcf407-b0f0-4545-bb8e-a5727e7b1482 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:52.840776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcf407-b0f0-4545-bb8e-a5727e7b1482 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:52.844339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f4c36-7abd-454e-8e93-da903965ce14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:52.844987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4c36-7abd-454e-8e93-da903965ce14 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:52.845270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4c36-7abd-454e-8e93-da903965ce14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:52.845545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4c36-7abd-454e-8e93-da903965ce14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:52.847340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0f6f4c36-7abd-454e-8e93-da903965ce14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:52.919679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f4c36-7abd-454e-8e93-da903965ce14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:52.921324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f4c36-7abd-454e-8e93-da903965ce14 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:52.936882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1120/2264] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:19:53.558883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:53.560505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:53.620347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a106d6-bb9b-4f74-9721-4cfcbe76d8b9 service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:53.637159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:53.638771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:53.639531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:53.640478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:53.649324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:53.740390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:53.740390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:53.775219 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1145/2265] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:19:57.731137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:57.733017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:57.733309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:57.753871 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:19:57.757085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:57.765872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1121/2266] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 16 21:19:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:19:57.830227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:57.855563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87a6c6-2043-4935-bb97-d3d517ec6198 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:57.863714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:57.864548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:57.864904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:57.865350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:57.877232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:57.879885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:57.905941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1146/2267] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:19:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 21:19:59.104964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:59.106770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:59.126516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90ba4a-d2b3-43b4-8d1a-732adf51ba31 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:59.132580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:59.133478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:59.133926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:59.134397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] PATH_INFO: `/v3/users/1d410832e6584828875128e31baa0ae8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:59.135640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d410832e6584828875128e31baa0ae8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:59.137692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:59.193315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d410832e6584828875128e31baa0ae8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.194251 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d410832e6584828875128e31baa0ae8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.195092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d410832e6584828875128e31baa0ae8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.208974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d410832e6584828875128e31baa0ae8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.218897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a9332c1d-584d-4d70-9c4c-e83a98c0c803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d410832e6584828875128e31baa0ae8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.237020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1122/2268] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:19:59 2022] DELETE /identity/v3/users/1d410832e6584828875128e31baa0ae8 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:19:59.437210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:59.455207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9abcea-d529-4381-ae62-36c679d68d3c service swift] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:59.526564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:59.527540 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:59.527894 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:59.528276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] PATH_INFO: `/v3/projects/6b341c2d77764f3890f2501cfc6945a7` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:59.529564 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b341c2d77764f3890f2501cfc6945a7)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:59.531590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:59.594081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b341c2d77764f3890f2501cfc6945a7', 'request_id': 'req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.602598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b341c2d77764f3890f2501cfc6945a7', 'request_id': 'req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.618267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b341c2d77764f3890f2501cfc6945a7', 'request_id': 'req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.633065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] The token cache is being invalidate because project 6b341c2d77764f3890f2501cfc6945a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:19:59.633725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.634598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e03fce42-46ec-4a2b-8fa0-7b626ab30f65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:19:59.636396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1147/2269] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:19:59 2022] DELETE /identity/v3/projects/6b341c2d77764f3890f2501cfc6945a7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:19:59.642242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d209-282e-4fd6-a972-499f74784aec None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:59.642817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d209-282e-4fd6-a972-499f74784aec None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:59.643321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4004d209-282e-4fd6-a972-499f74784aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:59.664855 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-4004d209-282e-4fd6-a972-499f74784aec None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:19:59.666145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4004d209-282e-4fd6-a972-499f74784aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:59.755328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:19:59.770258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1123/2270] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:19:59.779647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8639e7-4517-4615-be0a-f167bdb964b8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:59.780289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8639e7-4517-4615-be0a-f167bdb964b8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:59.780661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8639e7-4517-4615-be0a-f167bdb964b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:59.819284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cf8639e7-4517-4615-be0a-f167bdb964b8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:19:59.821664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cf8639e7-4517-4615-be0a-f167bdb964b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:19:59.836701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1148/2271] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:19:59.840676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d209-282e-4fd6-a972-499f74784aec None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:59.854432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4004d209-282e-4fd6-a972-499f74784aec None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:59.861616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:59.862497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:59.862936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:59.863545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:59.864520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:19:59.865035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:59.866662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:59.882874 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1124/2272] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:19:59.887072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8639e7-4517-4615-be0a-f167bdb964b8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:59.897426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8639e7-4517-4615-be0a-f167bdb964b8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:19:59.902354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:19:59.903131 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:19:59.903521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:19:59.903966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:19:59.904800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:19:59.906859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:19:59.951914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1149/2273] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:19:59 2022] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:19:59.953657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:19:59.968187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd1551-e351-45f4-9347-ae37f016845a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.054666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.055347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.055834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.056313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.057182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.059372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.093207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1125/2274] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:19:59 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:00.097284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.110884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490be9-5fcb-407d-bf3f-6fcdd0fc9369 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.122612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.123597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.124008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.124335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.125078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.127342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.146053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1150/2275] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:00.147179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.161197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d05cc-08ca-4bfb-a1cd-b66f710231bc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.166663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33710-1675-4a89-96fb-3e93fe373701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.167336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33710-1675-4a89-96fb-3e93fe373701 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.167616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33710-1675-4a89-96fb-3e93fe373701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.167974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33710-1675-4a89-96fb-3e93fe373701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.168758 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33710-1675-4a89-96fb-3e93fe373701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.170417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33710-1675-4a89-96fb-3e93fe373701 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.182409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1126/2276] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:00.186286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.209091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1389cfd-40ae-432b-b555-d39c7d4f2602 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.216125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.217296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.217808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.218090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] PATH_INFO: `/v3/projects/ec3507ea8ca84ffba1847c0218d1d616/users/8228385d08f14c84adc743717d674e74/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.248080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:00.255814 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec3507ea8ca84ffba1847c0218d1d616, user_id=8228385d08f14c84adc743717d674e74, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.263963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.304812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1151/2277] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:00 2022] PUT /identity/v3/projects/ec3507ea8ca84ffba1847c0218d1d616/users/8228385d08f14c84adc743717d674e74/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:00.311152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d250cd-c66a-4931-a79a-541bd0ea28e0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.311466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d250cd-c66a-4931-a79a-541bd0ea28e0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.312329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d250cd-c66a-4931-a79a-541bd0ea28e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.347448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-a5d250cd-c66a-4931-a79a-541bd0ea28e0 None None] MFA Rules not processed for user `8228385d08f14c84adc743717d674e74`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:00.349004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a5d250cd-c66a-4931-a79a-541bd0ea28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:00.449110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1127/2278] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:00.453484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.535186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54ac34-9641-415a-843b-d427478101b0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.542485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.543303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.543602 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.543948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.545130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.547227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.580201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1152/2279] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:00 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:00.581542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d250cd-c66a-4931-a79a-541bd0ea28e0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.617401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d250cd-c66a-4931-a79a-541bd0ea28e0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.694178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:00.704319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.705369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.705731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.706171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.707789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.711134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.746413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1128/2280] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:00 2022] POST /identity/v3/users => generated 309 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:00.751151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.766816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7185c7-68ca-419f-9953-cde39c2010d5 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.773729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.774526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.774857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.775352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.776339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.780269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.797101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1153/2281] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:00.802573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.824972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4cac1-e464-4cc2-be62-7e8da26be81d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.830217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.831453 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.831882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.832456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] PATH_INFO: `/v3/projects/6ba5a2b21ffa4a29969b6e21e76da02d/users/da56034f9a54424aa3fca992a765073c/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.851915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba5a2b21ffa4a29969b6e21e76da02d, user_id=da56034f9a54424aa3fca992a765073c, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.854679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.870433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1129/2282] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:00 2022] PUT /identity/v3/projects/6ba5a2b21ffa4a29969b6e21e76da02d/users/da56034f9a54424aa3fca992a765073c/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:00.874468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.886341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5163426-ff12-4fa1-9dde-d4e7c0626d54 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:00.958283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c491e4-c466-45e5-b43b-a08bc6ed77d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:00.959168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c491e4-c466-45e5-b43b-a08bc6ed77d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:00.959450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c491e4-c466-45e5-b43b-a08bc6ed77d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:00.959725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c491e4-c466-45e5-b43b-a08bc6ed77d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:00.960720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c491e4-c466-45e5-b43b-a08bc6ed77d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:00.962543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c491e4-c466-45e5-b43b-a08bc6ed77d6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:00.975663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1154/2283] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:00.980682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:00.994548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eb242-0d94-42c7-83e3-c6c6183f9100 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:01.001378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:01.002343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:01.002742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:01.003035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] PATH_INFO: `/v3/projects/6ba5a2b21ffa4a29969b6e21e76da02d/users/da56034f9a54424aa3fca992a765073c/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:01.006179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba5a2b21ffa4a29969b6e21e76da02d, user_id=da56034f9a54424aa3fca992a765073c, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:01.009073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:01.028483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1130/2284] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:00 2022] PUT /identity/v3/projects/6ba5a2b21ffa4a29969b6e21e76da02d/users/da56034f9a54424aa3fca992a765073c/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:01.035585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb0290-3a75-4b06-af0c-16bcce70d743 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:01.036312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb0290-3a75-4b06-af0c-16bcce70d743 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:01.036600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecb0290-3a75-4b06-af0c-16bcce70d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:01.076052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cecb0290-3a75-4b06-af0c-16bcce70d743 None None] MFA Rules not processed for user `da56034f9a54424aa3fca992a765073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:01.077818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cecb0290-3a75-4b06-af0c-16bcce70d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:01.143535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:01.184783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1155/2285] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:01.195537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:01.197409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:01.265519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684013dd-6c14-453b-9eb9-fb049616d341 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:01.269406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f527c7a-9aba-447e-9e17-9b56fc7dfe12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:01.270882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527c7a-9aba-447e-9e17-9b56fc7dfe12 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:01.271218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527c7a-9aba-447e-9e17-9b56fc7dfe12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:01.271497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f527c7a-9aba-447e-9e17-9b56fc7dfe12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:01.281209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527c7a-9aba-447e-9e17-9b56fc7dfe12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:01.282720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f527c7a-9aba-447e-9e17-9b56fc7dfe12 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:01.292993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1131/2286] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:01 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:01.474088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb0290-3a75-4b06-af0c-16bcce70d743 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:01.579699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecb0290-3a75-4b06-af0c-16bcce70d743 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:01.585025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:01.585912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:01.586201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:01.586478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] PATH_INFO: `/v3/users/8228385d08f14c84adc743717d674e74` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:01.587678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8228385d08f14c84adc743717d674e74)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:01.589650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:01.641095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8228385d08f14c84adc743717d674e74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:01.641759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8228385d08f14c84adc743717d674e74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:01.642374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8228385d08f14c84adc743717d674e74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:01.654750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8228385d08f14c84adc743717d674e74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:01.663936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8228385d08f14c84adc743717d674e74'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:01.677355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1156/2287] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:01 2022] DELETE /identity/v3/users/8228385d08f14c84adc743717d674e74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:01.682017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:01.682371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:01.682716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:01.700393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:01.701768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:01.766617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1132/2288] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:01.776511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:01.778036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:01.836248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8863d9a-17ed-45b6-9c80-2d8633ecd5f1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:01.840035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:01.840755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:01.841079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:01.841365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:01.855333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:01.858657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:01.871190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1157/2289] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:02.428070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:02.429614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:02.453922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb9bb6-c1aa-4525-bee0-7337b4ee84b9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:02.459731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:02.460654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:02.461164 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:02.461437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] PATH_INFO: `/v3/projects/ec3507ea8ca84ffba1847c0218d1d616` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:02.462854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec3507ea8ca84ffba1847c0218d1d616)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:02.465065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:02.550708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:02.559234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec3507ea8ca84ffba1847c0218d1d616', 'request_id': 'req-a6488064-1473-4343-9d8c-acad0da967a5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.579401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec3507ea8ca84ffba1847c0218d1d616', 'request_id': 'req-a6488064-1473-4343-9d8c-acad0da967a5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.596471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec3507ea8ca84ffba1847c0218d1d616', 'request_id': 'req-a6488064-1473-4343-9d8c-acad0da967a5'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.614279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] The token cache is being invalidate because project ec3507ea8ca84ffba1847c0218d1d616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:02.614931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.615969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.618218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1133/2290] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:02 2022] DELETE /identity/v3/projects/ec3507ea8ca84ffba1847c0218d1d616 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:02.622327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:02.634639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5000f-5e9e-49a9-9d44-438f530f6246 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:02.641187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:02.750352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:02.751246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:02.751533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:02.752197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] PATH_INFO: `/v3/users/da56034f9a54424aa3fca992a765073c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:02.753114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da56034f9a54424aa3fca992a765073c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:02.755329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:02.840594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da56034f9a54424aa3fca992a765073c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.841438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da56034f9a54424aa3fca992a765073c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.842486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da56034f9a54424aa3fca992a765073c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.866870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da56034f9a54424aa3fca992a765073c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.882937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da56034f9a54424aa3fca992a765073c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:02.903250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1158/2291] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:02 2022] DELETE /identity/v3/users/da56034f9a54424aa3fca992a765073c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:02.928243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:02.929755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:02.949271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6488064-1473-4343-9d8c-acad0da967a5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.013678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.014489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.014770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.015046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] PATH_INFO: `/v3/users/850e2609986546f68540aec652d1cd9f` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.016473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=850e2609986546f68540aec652d1cd9f)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.018480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.067143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850e2609986546f68540aec652d1cd9f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.067806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850e2609986546f68540aec652d1cd9f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.068534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850e2609986546f68540aec652d1cd9f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.080672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850e2609986546f68540aec652d1cd9f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.093280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850e2609986546f68540aec652d1cd9f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.109212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1134/2292] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:02 2022] DELETE /identity/v3/users/850e2609986546f68540aec652d1cd9f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:03.284247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.289075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:03.304840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de99b3-e316-487d-a8fe-91c83fc181f9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.383735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.385316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:03.411847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.411847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.412248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.412713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] PATH_INFO: `/v3/projects/6ba5a2b21ffa4a29969b6e21e76da02d` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.414000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba5a2b21ffa4a29969b6e21e76da02d)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.416350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.471023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:03.477155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:03.491204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba5a2b21ffa4a29969b6e21e76da02d', 'request_id': 'req-013d44df-dc41-495a-9f09-9c2219c0530e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.491737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1c8381-8c89-4be7-8b9c-ffc823b2b439 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.498907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba5a2b21ffa4a29969b6e21e76da02d', 'request_id': 'req-013d44df-dc41-495a-9f09-9c2219c0530e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.507618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba5a2b21ffa4a29969b6e21e76da02d', 'request_id': 'req-013d44df-dc41-495a-9f09-9c2219c0530e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.522326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] The token cache is being invalidate because project 6ba5a2b21ffa4a29969b6e21e76da02d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:03.522897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.523656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-013d44df-dc41-495a-9f09-9c2219c0530e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.525656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1159/2293] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:03 2022] DELETE /identity/v3/projects/6ba5a2b21ffa4a29969b6e21e76da02d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:03.530165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7acf85-ced6-476d-8b12-006347b666e0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.530472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7acf85-ced6-476d-8b12-006347b666e0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.530735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7acf85-ced6-476d-8b12-006347b666e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.553682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-af7acf85-ced6-476d-8b12-006347b666e0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:03.554924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-af7acf85-ced6-476d-8b12-006347b666e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:03.559381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.560312 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.560575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.560951 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] PATH_INFO: `/v3/projects/9868add8c6114cc2a3933d63b2e5652a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.562041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9868add8c6114cc2a3933d63b2e5652a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.563444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1160/2294] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:03.564224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.571858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c03d4-de14-4013-b900-c7ee07e0a382 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.572145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c03d4-de14-4013-b900-c7ee07e0a382 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.572450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c03d4-de14-4013-b900-c7ee07e0a382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.593448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7b0c03d4-de14-4013-b900-c7ee07e0a382 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:03.594882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7b0c03d4-de14-4013-b900-c7ee07e0a382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:03.607623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1161/2295] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:03.612068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c03d4-de14-4013-b900-c7ee07e0a382 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.620861 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9868add8c6114cc2a3933d63b2e5652a', 'request_id': 'req-9a20591d-1246-406b-aabb-041e65ad5d6d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.625927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c03d4-de14-4013-b900-c7ee07e0a382 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.627482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9868add8c6114cc2a3933d63b2e5652a', 'request_id': 'req-9a20591d-1246-406b-aabb-041e65ad5d6d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.640873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9868add8c6114cc2a3933d63b2e5652a', 'request_id': 'req-9a20591d-1246-406b-aabb-041e65ad5d6d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.654763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] The token cache is being invalidate because project 9868add8c6114cc2a3933d63b2e5652a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:03.655049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.655710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.657503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1135/2296] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:03 2022] DELETE /identity/v3/projects/9868add8c6114cc2a3933d63b2e5652a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:03.661321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.662666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:03.685460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.686135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.686424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.686828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.687567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:03.687878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.689531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.701756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1162/2297] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:20:03.706062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.707787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:03.719854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc0507-97a2-4eac-857e-f6c996046a09 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.724539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.725206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.725461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.725734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.726414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.728326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.731510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20591d-1246-406b-aabb-041e65ad5d6d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.736136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.737047 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.737438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.737721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] PATH_INFO: `/v3/users/0c303f98ab6a4103933ea8c9a98eecbb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.740611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c303f98ab6a4103933ea8c9a98eecbb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.742544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.755843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1163/2298] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:03 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:03.759905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.783762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:03.799687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c303f98ab6a4103933ea8c9a98eecbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.800489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c303f98ab6a4103933ea8c9a98eecbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.802212 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c303f98ab6a4103933ea8c9a98eecbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.814498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c303f98ab6a4103933ea8c9a98eecbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.822896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c303f98ab6a4103933ea8c9a98eecbb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:03.828081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadb929-4b6b-4880-b401-f0a64d17e284 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.833604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.834301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.834586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.834867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.835557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.837534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.837821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1136/2299] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:03 2022] DELETE /identity/v3/users/0c303f98ab6a4103933ea8c9a98eecbb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:03.860206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1164/2300] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:03 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:03.863170 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.864688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:03.939729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bae2a-a557-4151-b587-5509c97901c6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.950301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.951091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.951447 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.951797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.953088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.954480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.967056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1137/2301] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:03.971096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:03.982484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dda45d-2526-4e70-983b-96bc36fcdc9d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:03.987404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:03.988147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:03.988578 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:03.988930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:03.989754 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:03.991497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:03.992995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:04.006614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1165/2302] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:04.016190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.025890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.027225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c612532-77b7-4fb0-ab59-610f663e6a7a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.027883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.033373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f80fb-00a0-4ff2-8655-078820ed455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.034273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f80fb-00a0-4ff2-8655-078820ed455b admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.034558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f80fb-00a0-4ff2-8655-078820ed455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.034838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f80fb-00a0-4ff2-8655-078820ed455b admin admin] PATH_INFO: `/v3/projects/95c13395dea6494eaae4cc28ec14b5ba/users/850574acfd4f4975befecec8174d60fe/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.044213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c201886-9248-4f48-a9a2-b001bd96b1da admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.051587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.052612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.052897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.053305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] PATH_INFO: `/v3/projects/2e75c3de720b47a0a974635594e41f39` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.054670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e75c3de720b47a0a974635594e41f39)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.057237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.074096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f80fb-00a0-4ff2-8655-078820ed455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c13395dea6494eaae4cc28ec14b5ba, user_id=850574acfd4f4975befecec8174d60fe, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.076939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f80fb-00a0-4ff2-8655-078820ed455b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.095037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1138/2303] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:04 2022] PUT /identity/v3/projects/95c13395dea6494eaae4cc28ec14b5ba/users/850574acfd4f4975befecec8174d60fe/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:04.109920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d213-8355-4d42-bead-9da93800c491 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.110276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d213-8355-4d42-bead-9da93800c491 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.110491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180d213-8355-4d42-bead-9da93800c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.122399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e75c3de720b47a0a974635594e41f39', 'request_id': 'req-576688b6-25aa-40c4-bebf-a5b9fc84a54b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:04.130713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e75c3de720b47a0a974635594e41f39', 'request_id': 'req-576688b6-25aa-40c4-bebf-a5b9fc84a54b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:04.141517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e75c3de720b47a0a974635594e41f39', 'request_id': 'req-576688b6-25aa-40c4-bebf-a5b9fc84a54b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:04.156693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f180d213-8355-4d42-bead-9da93800c491 None None] MFA Rules not processed for user `850574acfd4f4975befecec8174d60fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:04.157928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f180d213-8355-4d42-bead-9da93800c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.165700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] The token cache is being invalidate because project 2e75c3de720b47a0a974635594e41f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:04.166058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:04.166841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-576688b6-25aa-40c4-bebf-a5b9fc84a54b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:04.168796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1166/2304] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:04 2022] DELETE /identity/v3/projects/2e75c3de720b47a0a974635594e41f39 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:04.173198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a5bd-28e5-4c4c-a555-e3f06e68acd2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.173744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a5bd-28e5-4c4c-a555-e3f06e68acd2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.173979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d28a5bd-28e5-4c4c-a555-e3f06e68acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.200212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3d28a5bd-28e5-4c4c-a555-e3f06e68acd2 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:04.202158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3d28a5bd-28e5-4c4c-a555-e3f06e68acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.252465 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1139/2305] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:04.254418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180d213-8355-4d42-bead-9da93800c491 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.255878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f180d213-8355-4d42-bead-9da93800c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.272014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:04.276232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1167/2306] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:04.285952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29fb8-a275-4f2b-82b9-9c169965d788 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.286738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29fb8-a275-4f2b-82b9-9c169965d788 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.287216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b29fb8-a275-4f2b-82b9-9c169965d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.315878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f3b29fb8-a275-4f2b-82b9-9c169965d788 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:04.317255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f3b29fb8-a275-4f2b-82b9-9c169965d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.327478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1168/2307] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:04.331623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29fb8-a275-4f2b-82b9-9c169965d788 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.338276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180d213-8355-4d42-bead-9da93800c491 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.343234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.343903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.344203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.344495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.345211 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.346279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b29fb8-a275-4f2b-82b9-9c169965d788 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.347307 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.352468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.353496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.353945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.354491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.355314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:04.355626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.357251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.371921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1169/2308] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:20:04.375885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.381344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1140/2309] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:04.382272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.387070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2db0-6e39-4c12-828a-73833ab40389 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.453325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.453998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.454285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.454615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.455312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.457326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.460929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:04.462299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e9eb0-11ad-469a-ac96-1dab1e9009ad admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.467815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.468676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.470155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.470354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.471124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.473211 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.491477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1170/2310] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:04.495377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.497017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1141/2311] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:04.501058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.512874 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc577149-6ab0-41b3-ad49-26ad0cc32c0b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.591209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.591209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.591209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.591209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.608069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.608069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.608069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1142/2312] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:04.608069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.608069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.609990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56720-2551-4f66-b277-bdbd9166a708 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.616647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.617483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.617896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.618294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.619294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.622643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.638729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:04.642503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1171/2313] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:04.643330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.654333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006e17d-2df6-49ce-812a-21f931888f8d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.659403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.660957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.661138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.661404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] PATH_INFO: `/v3/projects/711c8f7c894e445cabf00bcaeb42fc1e/users/f5a580fa55694fe3b256f90da9f3d393/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.676920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711c8f7c894e445cabf00bcaeb42fc1e, user_id=f5a580fa55694fe3b256f90da9f3d393, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.678650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea1afe-6e77-4059-886f-1529912c8bb5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.679664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.682354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.683002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.683313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.683569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.685615 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.693560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1172/2314] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:04 2022] PUT /identity/v3/projects/711c8f7c894e445cabf00bcaeb42fc1e/users/f5a580fa55694fe3b256f90da9f3d393/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:04.694371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.703983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.705741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.716803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1143/2315] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:04.717625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.727527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f09c7-9e77-40da-bfef-9c620116c001 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.769328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37deee-e5df-42d9-854a-177ba1b6c546 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.774648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.775581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.775919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.776294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.777023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.778872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.790629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1173/2316] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:04.791258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.792125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.792460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.792745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.793746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.794441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.795363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.807346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f660d61-da85-480e-92df-fac60f2a3166 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.812260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1144/2317] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:04.813138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.813812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.813942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.814120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.814381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.815100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.817714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.824139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f19af2-17d9-4164-8d1e-0edf92fc34e6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.831979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1174/2318] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:04.833233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.833404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff82af5-51bd-490a-95ce-bae481578b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.834194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff82af5-51bd-490a-95ce-bae481578b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.834480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff82af5-51bd-490a-95ce-bae481578b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.834754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff82af5-51bd-490a-95ce-bae481578b32 admin admin] PATH_INFO: `/v3/projects/711c8f7c894e445cabf00bcaeb42fc1e/users/f5a580fa55694fe3b256f90da9f3d393/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.836798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff82af5-51bd-490a-95ce-bae481578b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=711c8f7c894e445cabf00bcaeb42fc1e, user_id=f5a580fa55694fe3b256f90da9f3d393, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.839458 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff82af5-51bd-490a-95ce-bae481578b32 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.843947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de942f5-178c-42dd-85d0-6f4477c3b704 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:04.850987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1145/2319] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:04 2022] PUT /identity/v3/projects/711c8f7c894e445cabf00bcaeb42fc1e/users/f5a580fa55694fe3b256f90da9f3d393/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:04.860679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.860969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.861245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.890512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] MFA Rules not processed for user `f5a580fa55694fe3b256f90da9f3d393`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:04.891574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:04.891744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.924022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118979fa-619d-48e6-9e9c-89dbfb6e9b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:04.924959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118979fa-619d-48e6-9e9c-89dbfb6e9b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.925247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118979fa-619d-48e6-9e9c-89dbfb6e9b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.926294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118979fa-619d-48e6-9e9c-89dbfb6e9b38 admin admin] PATH_INFO: `/v3/projects/b568a213302f46fda9ab9467d36996c5/users/236f49a4117f488ea8bf5c523fadadc8/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.940538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118979fa-619d-48e6-9e9c-89dbfb6e9b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b568a213302f46fda9ab9467d36996c5, user_id=236f49a4117f488ea8bf5c523fadadc8, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:04.943769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118979fa-619d-48e6-9e9c-89dbfb6e9b38 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:04.958299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1175/2320] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:04 2022] PUT /identity/v3/projects/b568a213302f46fda9ab9467d36996c5/users/236f49a4117f488ea8bf5c523fadadc8/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:04.962987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:04.964099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:04.964099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:04.974470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1146/2321] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:04.982096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:04.983537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:04.985974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:04.987347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:05.028195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:05.051669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1176/2322] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:05.056085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae760a7c-8538-41df-b7db-a774d3af3df3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:05.063410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:05.064913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:05.117127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:05.117845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:05.118135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:05.118420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:05.138074 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cecd0-dda1-4f8c-b701-241c802421af None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:05.142061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:05.142771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:05.143183 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:05.143472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:05.155911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:05.157908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:05.170566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1177/2323] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:05.190158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:05.192883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:05.204421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1147/2324] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:20:05.292946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:05.303822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36643c-9012-4d28-b06b-d1259e17ab5e service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:05.307856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:05.308547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:05.308863 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:05.309142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:05.427820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:05.429364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:05.435360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:05.448421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1178/2325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:09.946901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:09.948528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:09.972085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8ab58-2801-49ae-9332-334f7975f15b service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:09.986120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:09.993105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:09.993603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:09.994074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] PATH_INFO: `/v3/users/2cb12a51b62c48ba95be62f167b7314e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:09.999051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb12a51b62c48ba95be62f167b7314e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:10.017779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:10.145520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb12a51b62c48ba95be62f167b7314e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.146609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb12a51b62c48ba95be62f167b7314e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.148655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb12a51b62c48ba95be62f167b7314e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.178809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb12a51b62c48ba95be62f167b7314e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.194408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-11227a79-e5e9-4ae5-a1f4-4b571fd45422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb12a51b62c48ba95be62f167b7314e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.233548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1148/2326] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:09 2022] DELETE /identity/v3/users/2cb12a51b62c48ba95be62f167b7314e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:10.475376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:10.491463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74193bd2-5156-4541-b799-ed62c447e662 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:10.622868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:10.623917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:10.624490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:10.625800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] PATH_INFO: `/v3/projects/f22cbeb1402848dbb84a5718dca357e1` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:10.628264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22cbeb1402848dbb84a5718dca357e1)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:10.631621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:10.699807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22cbeb1402848dbb84a5718dca357e1', 'request_id': 'req-4d006a07-724f-4bce-8dc0-bacbceaa2e84'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.707591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22cbeb1402848dbb84a5718dca357e1', 'request_id': 'req-4d006a07-724f-4bce-8dc0-bacbceaa2e84'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.725491 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22cbeb1402848dbb84a5718dca357e1', 'request_id': 'req-4d006a07-724f-4bce-8dc0-bacbceaa2e84'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.744236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] The token cache is being invalidate because project f22cbeb1402848dbb84a5718dca357e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:10.745053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.745800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d006a07-724f-4bce-8dc0-bacbceaa2e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:10.748272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1179/2327] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:10 2022] DELETE /identity/v3/projects/f22cbeb1402848dbb84a5718dca357e1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:10.752436 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46235b34-c623-41d4-8af5-4d38b82add72 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:10.753000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46235b34-c623-41d4-8af5-4d38b82add72 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:10.754840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46235b34-c623-41d4-8af5-4d38b82add72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:10.790096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-46235b34-c623-41d4-8af5-4d38b82add72 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:10.791354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-46235b34-c623-41d4-8af5-4d38b82add72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:10.797360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:10.909860 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1149/2328] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:10.918838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b358e-05f6-498a-9576-6a815e71536d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:10.919343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b358e-05f6-498a-9576-6a815e71536d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:10.919785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b358e-05f6-498a-9576-6a815e71536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:10.946192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7f0b358e-05f6-498a-9576-6a815e71536d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:10.948966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7f0b358e-05f6-498a-9576-6a815e71536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:10.976813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1180/2329] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:10.980621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46235b34-c623-41d4-8af5-4d38b82add72 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:10.992100 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46235b34-c623-41d4-8af5-4d38b82add72 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.002999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144744d-ea85-4375-b421-2fd5c3479d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.003706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144744d-ea85-4375-b421-2fd5c3479d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.004019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144744d-ea85-4375-b421-2fd5c3479d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.004398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144744d-ea85-4375-b421-2fd5c3479d68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.005674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144744d-ea85-4375-b421-2fd5c3479d68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:11.006046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144744d-ea85-4375-b421-2fd5c3479d68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.008012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144744d-ea85-4375-b421-2fd5c3479d68 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.029113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b358e-05f6-498a-9576-6a815e71536d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.036517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1150/2330] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:20:11.039373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b358e-05f6-498a-9576-6a815e71536d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.046266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.046946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.047228 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.047499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.048222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.050238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.050518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.050787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.053906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.081569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1181/2331] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:11.085602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] MFA Rules not processed for user `236f49a4117f488ea8bf5c523fadadc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:11.086640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.086905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.162454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a2263-1beb-468d-998b-404249ee5b9f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.167082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1151/2332] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:11.167668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.168607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.169055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.169473 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.170352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.171909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.172603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.173292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.182678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:11.191062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d160d-9e04-43b9-b408-7d0e88fcba14 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.198097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.199024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.199322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.199671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.200539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1182/2333] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:11.203513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.204216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.205562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.221008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4675145-3112-4242-b5e4-3bc2807ddbfb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.227599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.228504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.230221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.230830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.231459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.233493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.251126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1183/2334] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:11.253051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.261284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1152/2335] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:11.265228 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.267481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298284f0-c139-42af-8372-2e0c0be1e3e9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.348727 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.349409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.349697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.349977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.350711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.355852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.356814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e6dab-9f3d-4175-9551-951e9035f382 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.362936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.363864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.364314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.364596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.365297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.368215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.368353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1184/2336] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:11.371622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.378519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:11.391372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba645448-c04e-4256-b413-44851cbc51d9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.395471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1153/2337] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:11.399004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.400710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.402240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.402628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.403067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] PATH_INFO: `/v3/projects/dccb1e90ef654ad1af886f03fc712f54/users/9698979a44f84681a1d9c1ce3422141b/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.428953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f6b85-469e-415d-b7db-354a6265ee3e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.440341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.442374 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dccb1e90ef654ad1af886f03fc712f54, user_id=9698979a44f84681a1d9c1ce3422141b, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.442870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.443256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.443982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.445202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.449679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.450546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.464756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1154/2338] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:11.468134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1185/2339] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:11 2022] PUT /identity/v3/projects/dccb1e90ef654ad1af886f03fc712f54/users/9698979a44f84681a1d9c1ce3422141b/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:11.476402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.476402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.479396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.484748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc23cf4-37f3-4b8a-8ab2-6b5007248e45 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.558985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.559868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.560151 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.560499 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] PATH_INFO: `/v3/users/850574acfd4f4975befecec8174d60fe` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.561877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] RBAC: Authorizing `identity:delete_user(user_id=850574acfd4f4975befecec8174d60fe)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.563864 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.564984 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df464c-903d-4381-9c3d-88b62f789d79 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.570919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b391f-aaa9-4f75-8ead-bf7796ec5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.571512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b391f-aaa9-4f75-8ead-bf7796ec5e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.571868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b391f-aaa9-4f75-8ead-bf7796ec5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.572264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b391f-aaa9-4f75-8ead-bf7796ec5e5c admin admin] PATH_INFO: `/v3/projects/8390c06c0a13496b83e3be3c8ba69184/users/bfd30db32e6d471e9dc9def41048b9a8/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.589363 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b391f-aaa9-4f75-8ead-bf7796ec5e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8390c06c0a13496b83e3be3c8ba69184, user_id=bfd30db32e6d471e9dc9def41048b9a8, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.595022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b391f-aaa9-4f75-8ead-bf7796ec5e5c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.611002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1186/2340] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:11 2022] PUT /identity/v3/projects/8390c06c0a13496b83e3be3c8ba69184/users/bfd30db32e6d471e9dc9def41048b9a8/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:11.612751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ca94-daa2-4bba-9317-7d59173cfed2 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.613196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ca94-daa2-4bba-9317-7d59173cfed2 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.613653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ca94-daa2-4bba-9317-7d59173cfed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.632635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '850574acfd4f4975befecec8174d60fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:11.633466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '850574acfd4f4975befecec8174d60fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:11.634161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '850574acfd4f4975befecec8174d60fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:11.647249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f0a3ca94-daa2-4bba-9317-7d59173cfed2 None None] MFA Rules not processed for user `9698979a44f84681a1d9c1ce3422141b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:11.648786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f0a3ca94-daa2-4bba-9317-7d59173cfed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.649369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '850574acfd4f4975befecec8174d60fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:11.658404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '850574acfd4f4975befecec8174d60fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:11.679102 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:11.679789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1155/2341] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:11 2022] DELETE /identity/v3/users/850574acfd4f4975befecec8174d60fe => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:11.684310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.686020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.741942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1187/2342] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:11.743339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.743637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.743920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.762037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:11.763270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.775608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1188/2343] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:11.775800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c16381-5826-4069-ac39-8de92666547a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.775902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.778709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.785485 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.786182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.786476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.786756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.787596 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.789254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.791964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed3c0c-ac67-4047-b720-fab3e764d5bc None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.795520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:11.797461 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.798162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.798430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.798697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.799604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.802813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.804489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1156/2344] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:11.808238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.810507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:11.851230 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1189/2345] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:11.852485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:11.896052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ebc05-7759-44f4-96f3-2b5cca9889db admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.952686 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.953356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.953641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.953922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.968434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.970410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.973299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ca24c-7a83-430d-a219-a609a92f8f92 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:11.979873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:11.980954 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:11.981247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:11.981556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] PATH_INFO: `/v3/projects/8390c06c0a13496b83e3be3c8ba69184/users/bfd30db32e6d471e9dc9def41048b9a8/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:11.983636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8390c06c0a13496b83e3be3c8ba69184, user_id=bfd30db32e6d471e9dc9def41048b9a8, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:11.986389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:11.997527 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1157/2346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:11.998225 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.009899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef671c80-1d77-4a31-8995-b900557a85fc service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.013321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1190/2347] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:11 2022] PUT /identity/v3/projects/8390c06c0a13496b83e3be3c8ba69184/users/bfd30db32e6d471e9dc9def41048b9a8/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:12.131271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.135091 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.135669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.139987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.140868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.147019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.198008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1158/2348] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:11 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:12.201901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.213936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a911de-0947-4ce5-b801-35b708778982 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.233718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.234462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.234759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.235039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.235836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.239889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.258781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1191/2349] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:12.262922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.277359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f81b1c-c474-4f1e-80c0-a91fcb133073 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.288846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.291097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.292157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.292157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] PATH_INFO: `/v3/projects/e876b766a83f4efda456906b98618680/users/4b94b4700b0a49d59fa3799532bfeb8b/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.335046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e876b766a83f4efda456906b98618680, user_id=4b94b4700b0a49d59fa3799532bfeb8b, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.338530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.370389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1159/2350] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:12 2022] PUT /identity/v3/projects/e876b766a83f4efda456906b98618680/users/4b94b4700b0a49d59fa3799532bfeb8b/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:12.374287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.390691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870d209-2259-48fc-b5a1-a4b7892732ad admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.460325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.462265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:12.507078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:12.548646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.549532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.549837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.550118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.552027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.554370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.572164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1192/2351] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:12.573557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.580992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f1161-c5a9-426c-b2db-6e08a0f58ac8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.600221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d5802-6c57-4073-8465-ff5db5924652 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.608542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.609444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.609730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.610011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] PATH_INFO: `/v3/projects/95c13395dea6494eaae4cc28ec14b5ba` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.617155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c13395dea6494eaae4cc28ec14b5ba)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.619362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.625198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb544-340c-4dcb-9324-7c58f55fe2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.626295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb544-340c-4dcb-9324-7c58f55fe2ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.626585 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb544-340c-4dcb-9324-7c58f55fe2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.627431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb544-340c-4dcb-9324-7c58f55fe2ca admin admin] PATH_INFO: `/v3/projects/e876b766a83f4efda456906b98618680/users/4b94b4700b0a49d59fa3799532bfeb8b/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.631918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb544-340c-4dcb-9324-7c58f55fe2ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e876b766a83f4efda456906b98618680, user_id=4b94b4700b0a49d59fa3799532bfeb8b, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.639548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb544-340c-4dcb-9324-7c58f55fe2ca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.667088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1193/2352] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:12 2022] PUT /identity/v3/projects/e876b766a83f4efda456906b98618680/users/4b94b4700b0a49d59fa3799532bfeb8b/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:12.679116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.679498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.679845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.686373 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:12.728118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c13395dea6494eaae4cc28ec14b5ba', 'request_id': 'req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.737160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c13395dea6494eaae4cc28ec14b5ba', 'request_id': 'req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.739166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] MFA Rules not processed for user `4b94b4700b0a49d59fa3799532bfeb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:12.740624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:12.756703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c13395dea6494eaae4cc28ec14b5ba', 'request_id': 'req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.778729 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] The token cache is being invalidate because project 95c13395dea6494eaae4cc28ec14b5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:12.778938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.779690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.782319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1160/2353] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:12 2022] DELETE /identity/v3/projects/95c13395dea6494eaae4cc28ec14b5ba => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:12.787806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.789587 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:12.865555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1194/2354] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:12.880859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:12.883867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:12.893297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc67b47-6c15-4634-9ac5-ce0e801ddcb4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.901356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.902248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.902534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.902809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] PATH_INFO: `/v3/users/f5a580fa55694fe3b256f90da9f3d393` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.904033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a580fa55694fe3b256f90da9f3d393)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.906000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.971436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f912c0b-1767-45d3-b440-b59ef133cc72 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:12.976401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:12.977287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:12.977767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:12.978294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:12.980706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a580fa55694fe3b256f90da9f3d393'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.981459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a580fa55694fe3b256f90da9f3d393'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.982156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a580fa55694fe3b256f90da9f3d393'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:12.990496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:12.992601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:12.992925 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:12.999895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a580fa55694fe3b256f90da9f3d393'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:13.008322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1195/2355] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:13.012658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a580fa55694fe3b256f90da9f3d393'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:13.037589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1161/2356] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:12 2022] DELETE /identity/v3/users/f5a580fa55694fe3b256f90da9f3d393 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:13.134657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:13.146672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594ac9-5741-4535-ad70-60b6bb162bc7 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:13.222966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36cbb1-51d5-4ec0-b08f-9a6687a84752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:13.223307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36cbb1-51d5-4ec0-b08f-9a6687a84752 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:13.223547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36cbb1-51d5-4ec0-b08f-9a6687a84752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:13.223834 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36cbb1-51d5-4ec0-b08f-9a6687a84752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:13.226044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4d36cbb1-51d5-4ec0-b08f-9a6687a84752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:13.280104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:13.296773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36cbb1-51d5-4ec0-b08f-9a6687a84752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:13.298369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36cbb1-51d5-4ec0-b08f-9a6687a84752 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:13.311743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1196/2357] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:13.526828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:13.528355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:13.650483 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418bcd6-e718-449f-b192-84357dcdf35a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:13.657297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:13.658402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:13.658716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:13.659448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] PATH_INFO: `/v3/projects/711c8f7c894e445cabf00bcaeb42fc1e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:13.662668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] RBAC: Authorizing `identity:delete_project(project_id=711c8f7c894e445cabf00bcaeb42fc1e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:13.665119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:13.741506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '711c8f7c894e445cabf00bcaeb42fc1e', 'request_id': 'req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:13.752960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '711c8f7c894e445cabf00bcaeb42fc1e', 'request_id': 'req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:13.784869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '711c8f7c894e445cabf00bcaeb42fc1e', 'request_id': 'req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:13.801815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] The token cache is being invalidate because project 711c8f7c894e445cabf00bcaeb42fc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:13.802904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:13.805214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-38505c8f-ffe3-43bf-8721-7d0ad8f1839e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:13.812515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1162/2358] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:13 2022] DELETE /identity/v3/projects/711c8f7c894e445cabf00bcaeb42fc1e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:13.814479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0490d18-3aff-4b1e-8ca1-8a598ef361c7 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:13.815239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0490d18-3aff-4b1e-8ca1-8a598ef361c7 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:13.815889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0490d18-3aff-4b1e-8ca1-8a598ef361c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:13.843389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e0490d18-3aff-4b1e-8ca1-8a598ef361c7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:13.844824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e0490d18-3aff-4b1e-8ca1-8a598ef361c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:13.959433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1197/2359] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:13.962187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d6394-b711-486c-b79d-5e1608475a53 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:13.963515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d6394-b711-486c-b79d-5e1608475a53 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:13.966345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d6394-b711-486c-b79d-5e1608475a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:13.999329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2c3d6394-b711-486c-b79d-5e1608475a53 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:14.000916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2c3d6394-b711-486c-b79d-5e1608475a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:14.017975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1163/2360] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:14.021845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0490d18-3aff-4b1e-8ca1-8a598ef361c7 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.037199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0490d18-3aff-4b1e-8ca1-8a598ef361c7 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:14.043937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:14.044660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.044944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.045222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.045963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:14.046554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:14.060908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:14.078819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1198/2361] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:20:14.084068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d6394-b711-486c-b79d-5e1608475a53 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.098682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d6394-b711-486c-b79d-5e1608475a53 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:14.111627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:14.112502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.112678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.112956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.114272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:14.116621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:14.152372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1164/2362] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:14 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:14.156642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.178773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ebdaa-c674-4594-adbb-f4742a53ee1b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:14.328570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:14.329277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.329626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.329829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.330547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:14.333580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:14.362162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1199/2363] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:14 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:14.363468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.378479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41d060-e8de-4a27-a77f-17d41edc9d61 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:14.384665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:14.385666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.386038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.386440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.387292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:14.389069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:14.403443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1165/2364] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:14.407314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.418672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d1906-6ab0-44f2-a402-9c9c122bcd81 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:14.424888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512d9cb-c8b6-4006-8406-0a048ae0d429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:14.425783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d9cb-c8b6-4006-8406-0a048ae0d429 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.426384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d9cb-c8b6-4006-8406-0a048ae0d429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.426688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d9cb-c8b6-4006-8406-0a048ae0d429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.427728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d9cb-c8b6-4006-8406-0a048ae0d429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:14.429488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d9cb-c8b6-4006-8406-0a048ae0d429 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:14.441041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1200/2365] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:14.445643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.458159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265e456-6a3f-4f2a-b61b-62f777b6b78c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:14.465243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:14.466162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.467116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.467397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] PATH_INFO: `/v3/projects/116aeb4073524458aab05899c038330c/users/ba68052b07a04ae3b67591f5e877cb96/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.488004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] RBAC: Authorizing `identity:create_grant(project_id=116aeb4073524458aab05899c038330c, user_id=ba68052b07a04ae3b67591f5e877cb96, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:14.491371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:14.501866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:14.516477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1166/2366] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:14 2022] PUT /identity/v3/projects/116aeb4073524458aab05899c038330c/users/ba68052b07a04ae3b67591f5e877cb96/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:14.523674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d94a3-6a6a-4077-9b4f-172913a2e170 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.526075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d94a3-6a6a-4077-9b4f-172913a2e170 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.526075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5d94a3-6a6a-4077-9b4f-172913a2e170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.552976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ae5d94a3-6a6a-4077-9b4f-172913a2e170 None None] MFA Rules not processed for user `ba68052b07a04ae3b67591f5e877cb96`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:14.554300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ae5d94a3-6a6a-4077-9b4f-172913a2e170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:14.610110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:14.653128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1201/2367] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:14.657324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.798536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149cd13-cd1a-4a1b-9c35-ba556edb574d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:14.807558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:14.811037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:14.811535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:14.812038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:14.812946 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:14.816815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:14.878600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1167/2368] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:14 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:14.880434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d94a3-6a6a-4077-9b4f-172913a2e170 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:14.895942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5d94a3-6a6a-4077-9b4f-172913a2e170 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:15.043667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:15.044793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:15.045161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:15.045519 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:15.046406 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:15.048634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:15.088498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1202/2369] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:14 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:15.094852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:15.109797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011bbb9-f638-4c04-a84e-5c1a92e29d30 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:15.117895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:15.118763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:15.119097 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:15.119484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:15.121156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:15.126486 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:15.155905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1168/2370] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:15.157155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:15.176268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff0f54-5e3e-4523-aed3-f6d71948de86 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:15.184494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:15.185415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:15.185697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:15.185972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] PATH_INFO: `/v3/projects/1ddb78a9417149aab1e86f0cb5867239/users/a60df99779414386a9a19ebc932d1110/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:15.221812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ddb78a9417149aab1e86f0cb5867239, user_id=a60df99779414386a9a19ebc932d1110, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:15.229375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:15.270761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1203/2371] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:15 2022] PUT /identity/v3/projects/1ddb78a9417149aab1e86f0cb5867239/users/a60df99779414386a9a19ebc932d1110/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:15.272079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:15.284346 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f79c6-a246-4b00-a454-068e4ecaf3e3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:15.420015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7323e8-2e7d-46f0-8a9e-2e26baa6a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:15.420703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7323e8-2e7d-46f0-8a9e-2e26baa6a800 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:15.421022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7323e8-2e7d-46f0-8a9e-2e26baa6a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:15.421284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7323e8-2e7d-46f0-8a9e-2e26baa6a800 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:15.422560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7323e8-2e7d-46f0-8a9e-2e26baa6a800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:15.423992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7323e8-2e7d-46f0-8a9e-2e26baa6a800 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:15.444380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1169/2372] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:15.446405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:15.462234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8358f-364a-451e-b512-fd3e086b6ca8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:15.468280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:15.469422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:15.469838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:15.470184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] PATH_INFO: `/v3/projects/1ddb78a9417149aab1e86f0cb5867239/users/a60df99779414386a9a19ebc932d1110/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:15.534016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ddb78a9417149aab1e86f0cb5867239, user_id=a60df99779414386a9a19ebc932d1110, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:15.536993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:15.588236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1204/2373] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:15 2022] PUT /identity/v3/projects/1ddb78a9417149aab1e86f0cb5867239/users/a60df99779414386a9a19ebc932d1110/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:15.594537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1716c6-68df-4559-a13b-9213d741afc4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:15.595056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1716c6-68df-4559-a13b-9213d741afc4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:15.595455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1716c6-68df-4559-a13b-9213d741afc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:15.671265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9e1716c6-68df-4559-a13b-9213d741afc4 None None] MFA Rules not processed for user `a60df99779414386a9a19ebc932d1110`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:15.672768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9e1716c6-68df-4559-a13b-9213d741afc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:15.841322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:15.868224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1170/2374] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:15.875702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:15.877813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:15.970030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397becdd-a21d-4e35-9d60-066a669f1f1f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:15.974637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:15.975385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:15.975758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:15.976108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:16.042380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:16.062700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:16.064720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:16.082961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1205/2375] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:18.201688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:18.202221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:18.202350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:18.232599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] MFA Rules not processed for user `bfd30db32e6d471e9dc9def41048b9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:18.234152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:18.313061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1171/2376] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:18.327511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:18.329668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:18.407770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122e97a-cebd-4f70-b9e7-2aba7bf5d6c2 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:18.413290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:18.413939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:18.414221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:18.414490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:18.416289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:18.481119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:18.482850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:18.493030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1206/2377] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:23.405068 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:23.406796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:23.421468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262eb06-41e5-4d4b-86cf-c2f2625295fa None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:23.428121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e47ca-e792-4b89-8315-24d6e9b28e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:23.428830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e47ca-e792-4b89-8315-24d6e9b28e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:23.429126 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e47ca-e792-4b89-8315-24d6e9b28e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:23.429401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e47ca-e792-4b89-8315-24d6e9b28e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:23.444331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e47ca-e792-4b89-8315-24d6e9b28e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:23.446461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e47ca-e792-4b89-8315-24d6e9b28e42 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:23.461925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1172/2378] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:24.302463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:24.303897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:24.375323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348f779-6ab0-4262-9dd4-98eaa18cbfdf service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:24.380304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:24.381199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:24.381489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:24.381770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] PATH_INFO: `/v3/users/9698979a44f84681a1d9c1ce3422141b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:24.383009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9698979a44f84681a1d9c1ce3422141b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:24.385037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:24.414445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:24.435817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9698979a44f84681a1d9c1ce3422141b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:24.436500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9698979a44f84681a1d9c1ce3422141b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:24.437154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9698979a44f84681a1d9c1ce3422141b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:24.449891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9698979a44f84681a1d9c1ce3422141b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:24.457303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9698979a44f84681a1d9c1ce3422141b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:24.470101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1207/2379] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:24 2022] DELETE /identity/v3/users/9698979a44f84681a1d9c1ce3422141b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:24.475315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:24.475812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:24.475927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:24.494561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:24.496049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:24.562210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1173/2380] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:24.572613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:24.574121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:24.642326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086aae2-b761-4a7f-9843-cae5947a960a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:24.650460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:24.651146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:24.651459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:24.651998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:24.662620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:24.664050 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:24.674588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1208/2381] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:20:24.962835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:24.964382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:24.977854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a7e2ba-33d8-40cb-83c7-4932f871b537 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:24.984246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:24.985429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:24.985863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:24.986247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] PATH_INFO: `/v3/projects/dccb1e90ef654ad1af886f03fc712f54` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:24.987571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dccb1e90ef654ad1af886f03fc712f54)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:24.992530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:25.061004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dccb1e90ef654ad1af886f03fc712f54', 'request_id': 'req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.069543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dccb1e90ef654ad1af886f03fc712f54', 'request_id': 'req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.077997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dccb1e90ef654ad1af886f03fc712f54', 'request_id': 'req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.080765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:25.092521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] The token cache is being invalidate because project dccb1e90ef654ad1af886f03fc712f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:25.093364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.094434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.096892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1174/2382] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:24 2022] DELETE /identity/v3/projects/dccb1e90ef654ad1af886f03fc712f54 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:25.101855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:25.112205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bfde0-4652-4a35-8efc-c295b7ea0a37 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:25.175915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:25.177612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:25.177898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:25.178172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] PATH_INFO: `/v3/users/4b94b4700b0a49d59fa3799532bfeb8b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:25.179360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b94b4700b0a49d59fa3799532bfeb8b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:25.181328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:25.229654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b94b4700b0a49d59fa3799532bfeb8b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.230278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b94b4700b0a49d59fa3799532bfeb8b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.230890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b94b4700b0a49d59fa3799532bfeb8b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.232082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:25.246457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b94b4700b0a49d59fa3799532bfeb8b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.254601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2d7b504e-2323-4629-81ea-70baeb6ebf3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b94b4700b0a49d59fa3799532bfeb8b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.267081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1209/2383] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:25 2022] DELETE /identity/v3/users/4b94b4700b0a49d59fa3799532bfeb8b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:25.571962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:25.573540 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:25.590352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec73b48-b5db-48a5-add9-e0f44a66eb7a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:25.659267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:25.660144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:25.660744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:25.661166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] PATH_INFO: `/v3/projects/e876b766a83f4efda456906b98618680` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:25.662420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e876b766a83f4efda456906b98618680)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:25.664440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:25.717435 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e876b766a83f4efda456906b98618680', 'request_id': 'req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.728276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e876b766a83f4efda456906b98618680', 'request_id': 'req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.734805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e876b766a83f4efda456906b98618680', 'request_id': 'req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.745847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] The token cache is being invalidate because project e876b766a83f4efda456906b98618680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:25.746130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.746776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ac28daff-dcb6-4af8-ab1e-a05bee6e9870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:25.748366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1175/2384] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:25 2022] DELETE /identity/v3/projects/e876b766a83f4efda456906b98618680 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:25.753701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2de5e-909f-456a-835d-ee5c7fc8a2de None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:25.754840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2de5e-909f-456a-835d-ee5c7fc8a2de None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:25.755294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2de5e-909f-456a-835d-ee5c7fc8a2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:25.775654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7dd2de5e-909f-456a-835d-ee5c7fc8a2de None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:25.776893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7dd2de5e-909f-456a-835d-ee5c7fc8a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:25.841510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1210/2385] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:25.851807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d82b-0e61-4731-815b-e4c4d94f714b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:25.851807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d82b-0e61-4731-815b-e4c4d94f714b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:25.851807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30d82b-0e61-4731-815b-e4c4d94f714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:25.871716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-cf30d82b-0e61-4731-815b-e4c4d94f714b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:25.872966 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cf30d82b-0e61-4731-815b-e4c4d94f714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:25.881608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1176/2386] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:25.885959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2de5e-909f-456a-835d-ee5c7fc8a2de None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:25.897944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2de5e-909f-456a-835d-ee5c7fc8a2de None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:25.902551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:25.903218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:25.903499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:25.903778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:25.904574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:25.904882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:25.906495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:25.919442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1211/2387] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:20:25.924127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30d82b-0e61-4731-815b-e4c4d94f714b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:25.934160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30d82b-0e61-4731-815b-e4c4d94f714b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:25.938823 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:25.939544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:25.939949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:25.940327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:25.941207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:25.944233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:25.970975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1177/2388] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:25 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:25.975492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:25.985518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba388c8-20d4-47c2-834b-059981535c64 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.045332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.046078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.046710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.047037 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.047888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.050355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.075618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1212/2389] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:25 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:26.079102 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.089800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b155-1f34-41c0-b7b1-ec656cb98c6c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.094396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.095042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.095330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.095608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.096376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.098035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.108657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1178/2390] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:26.114164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.124618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca565f-11f1-42da-9fb4-ef0d65ae52b7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.130023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c3a6f-5569-4318-9061-66f2e056dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.130681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c3a6f-5569-4318-9061-66f2e056dd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.130962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c3a6f-5569-4318-9061-66f2e056dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.131237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c3a6f-5569-4318-9061-66f2e056dd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.131963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c3a6f-5569-4318-9061-66f2e056dd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.133621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c3a6f-5569-4318-9061-66f2e056dd5f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.146069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1213/2391] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:26.150339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.162176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5e7d4-b778-4eda-8b4c-f803d2b7a119 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.167191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.168096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.168397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.168673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] PATH_INFO: `/v3/projects/54f0d8d4728b49f0b886518bc36933a1/users/bd1b7dde71ed41c189fc8fa4cdf966e3/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.194647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54f0d8d4728b49f0b886518bc36933a1, user_id=bd1b7dde71ed41c189fc8fa4cdf966e3, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.197403 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.214337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1179/2392] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:26 2022] PUT /identity/v3/projects/54f0d8d4728b49f0b886518bc36933a1/users/bd1b7dde71ed41c189fc8fa4cdf966e3/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:26.224974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8250-9012-4e25-bc30-27d7cf53917e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.225331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8250-9012-4e25-bc30-27d7cf53917e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.225649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae8250-9012-4e25-bc30-27d7cf53917e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.260784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c2ae8250-9012-4e25-bc30-27d7cf53917e None None] MFA Rules not processed for user `bd1b7dde71ed41c189fc8fa4cdf966e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:26.262028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c2ae8250-9012-4e25-bc30-27d7cf53917e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:26.288532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:26.341538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1214/2393] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:26.346133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.367174 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:26.416707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653c1b6-5bb1-45e3-b1fd-87e718c646c4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.421635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.422595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.423023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.423451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.424506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.428229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.454481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1180/2394] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:26 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:26.459237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae8250-9012-4e25-bc30-27d7cf53917e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.471575 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae8250-9012-4e25-bc30-27d7cf53917e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.539062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.539878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.540162 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.540484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.541187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.543249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.564420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1215/2395] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:26 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:26.569220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.579472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0e47c-3bf5-4b61-8cf8-c529b077e3bc admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.585455 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.586233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.586668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.586993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.587728 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.589410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.601036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1181/2396] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:26.605653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.616619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3c1a9-8a5a-4c6e-8f83-1db0110a1a99 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.621618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.622521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.622798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.623075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] PATH_INFO: `/v3/projects/edfd4c799066454b9d8bd9e04a480595/users/be178b38b02245bfbb545a043a4b4604/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.639153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd4c799066454b9d8bd9e04a480595, user_id=be178b38b02245bfbb545a043a4b4604, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.642105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.656293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1216/2397] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:26 2022] PUT /identity/v3/projects/edfd4c799066454b9d8bd9e04a480595/users/be178b38b02245bfbb545a043a4b4604/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:26.660644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.671150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3dc69-357e-4c10-8dec-2bd61b1052f1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.730086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27710b92-e650-447e-bdb8-cd8d8cf67de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.730771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27710b92-e650-447e-bdb8-cd8d8cf67de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.731050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27710b92-e650-447e-bdb8-cd8d8cf67de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.731325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27710b92-e650-447e-bdb8-cd8d8cf67de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.732106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27710b92-e650-447e-bdb8-cd8d8cf67de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.733740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27710b92-e650-447e-bdb8-cd8d8cf67de2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.745315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1182/2398] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:26.749500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.759724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bb872-bbaa-49f6-b306-dee8070abe2f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:26.764380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:26.765283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.765567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.765840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] PATH_INFO: `/v3/projects/edfd4c799066454b9d8bd9e04a480595/users/be178b38b02245bfbb545a043a4b4604/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.767817 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edfd4c799066454b9d8bd9e04a480595, user_id=be178b38b02245bfbb545a043a4b4604, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:26.771191 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:26.781838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1217/2399] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:26 2022] PUT /identity/v3/projects/edfd4c799066454b9d8bd9e04a480595/users/be178b38b02245bfbb545a043a4b4604/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:26.793553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:26.793867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:26.794181 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:26.820896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] MFA Rules not processed for user `be178b38b02245bfbb545a043a4b4604`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:26.822167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:26.902623 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1183/2400] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:26.913778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.915756 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:26.990578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:26.992008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:26.996662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e369d-8cd6-4f4e-84ad-9123926a9a48 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:27.000666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:27.001323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:27.001633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:27.001903 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:27.009273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:27.031161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:27.056780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44eed5e-35e4-4a66-8548-eaefc11396e3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:27.061020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cec863-7a9d-4a53-9b30-8ff8ddd026fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:27.061808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cec863-7a9d-4a53-9b30-8ff8ddd026fc service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:27.062174 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cec863-7a9d-4a53-9b30-8ff8ddd026fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:27.062551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cec863-7a9d-4a53-9b30-8ff8ddd026fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:27.064643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-37cec863-7a9d-4a53-9b30-8ff8ddd026fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:27.068928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:27.070986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:27.080760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1218/2401] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:27.143653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cec863-7a9d-4a53-9b30-8ff8ddd026fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:27.145711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cec863-7a9d-4a53-9b30-8ff8ddd026fc service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:27.159489 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1184/2402] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:20:28.517372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:28.518982 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:28.542066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87caf34-25b2-457f-86d8-084376820aba service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:28.546937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:28.555591 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:28.555891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:28.556196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] PATH_INFO: `/v3/users/ba68052b07a04ae3b67591f5e877cb96` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:28.557719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba68052b07a04ae3b67591f5e877cb96)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:28.560270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:28.643536 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba68052b07a04ae3b67591f5e877cb96'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:28.644213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba68052b07a04ae3b67591f5e877cb96'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:28.646184 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba68052b07a04ae3b67591f5e877cb96'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:28.677492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba68052b07a04ae3b67591f5e877cb96'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:28.689820 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba68052b07a04ae3b67591f5e877cb96'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:28.705111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1219/2403] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:28 2022] DELETE /identity/v3/users/ba68052b07a04ae3b67591f5e877cb96 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:28.714831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:28.714831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:28.714831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:28.755785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:28.757359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:28.843070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1185/2404] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:28.854282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:28.856108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:28.928266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd323ca-ff21-4f47-b7c5-a619d463880c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:28.932225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:28.932909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:28.933198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:28.933482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:28.944352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:28.945743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:28.958433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1220/2405] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:20:29.409197 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:29.411651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:29.431781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81ed74-4b11-4287-a038-ab1a48aa8496 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:29.436808 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:29.437701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:29.437986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:29.438440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] PATH_INFO: `/v3/projects/116aeb4073524458aab05899c038330c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:29.439842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=116aeb4073524458aab05899c038330c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:29.442471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:29.495045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '116aeb4073524458aab05899c038330c', 'request_id': 'req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.502170 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '116aeb4073524458aab05899c038330c', 'request_id': 'req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.515720 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:29.523995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '116aeb4073524458aab05899c038330c', 'request_id': 'req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.547408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] The token cache is being invalidate because project 116aeb4073524458aab05899c038330c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:29.547630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.548496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.550397 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1186/2406] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:29 2022] DELETE /identity/v3/projects/116aeb4073524458aab05899c038330c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:29.555454 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:29.569203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6333c-90c5-40ab-86fe-b0cb9b25509f service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:29.621599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:29.652941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:29.654010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:29.654547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:29.654933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] PATH_INFO: `/v3/users/a60df99779414386a9a19ebc932d1110` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:29.656398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60df99779414386a9a19ebc932d1110)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:29.661097 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:29.726431 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60df99779414386a9a19ebc932d1110'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.727193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60df99779414386a9a19ebc932d1110'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.728244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60df99779414386a9a19ebc932d1110'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.750826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60df99779414386a9a19ebc932d1110'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.758571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4c401f7b-9f16-4423-a8fb-efcd81b163a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60df99779414386a9a19ebc932d1110'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:29.775328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1221/2407] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:29 2022] DELETE /identity/v3/users/a60df99779414386a9a19ebc932d1110 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:30.077074 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.079785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:30.095222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff8c08c-d6f0-41d4-b137-d00abec8c9c7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.173605 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.174591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.175090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.175430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] PATH_INFO: `/v3/projects/1ddb78a9417149aab1e86f0cb5867239` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.179643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ddb78a9417149aab1e86f0cb5867239)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.180779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.243187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ddb78a9417149aab1e86f0cb5867239', 'request_id': 'req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.253809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ddb78a9417149aab1e86f0cb5867239', 'request_id': 'req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.264104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ddb78a9417149aab1e86f0cb5867239', 'request_id': 'req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.280819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] The token cache is being invalidate because project 1ddb78a9417149aab1e86f0cb5867239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:30.281146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.281754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e2747a8d-4dd2-4b05-b175-0be97e3b36ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.284127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1187/2408] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:30 2022] DELETE /identity/v3/projects/1ddb78a9417149aab1e86f0cb5867239 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:30.290827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71a927-8d10-4134-9c65-6d5fd005f867 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.291142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71a927-8d10-4134-9c65-6d5fd005f867 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.291433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71a927-8d10-4134-9c65-6d5fd005f867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.326815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-cc71a927-8d10-4134-9c65-6d5fd005f867 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:30.328331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-cc71a927-8d10-4134-9c65-6d5fd005f867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:30.442504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1222/2409] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:30.444287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a345-efa3-4735-b55e-40a652cd04f6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.444688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a345-efa3-4735-b55e-40a652cd04f6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.445066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1a345-efa3-4735-b55e-40a652cd04f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.475266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9da1a345-efa3-4735-b55e-40a652cd04f6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:30.476956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9da1a345-efa3-4735-b55e-40a652cd04f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:30.491260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71a927-8d10-4134-9c65-6d5fd005f867 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.496246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1188/2410] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:30.502106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71a927-8d10-4134-9c65-6d5fd005f867 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.509610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.509926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.510025 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.510370 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.511220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:30.511587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.513611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.527224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1223/2411] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:20:30.531883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a345-efa3-4735-b55e-40a652cd04f6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.547220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1a345-efa3-4735-b55e-40a652cd04f6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.553131 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.553618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.554013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.554290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.555066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.557316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.611634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1189/2412] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:30 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:30.617278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.632760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5917b8-4b61-4249-bb12-f5ae36664df7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.694990 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:30.711504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.712316 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.712663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.713001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.714182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.716217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.741178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1224/2413] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:30 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:30.746602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.761887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5033765-f6a2-4779-a0df-ddadb2b8300b admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.774032 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.774723 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.775009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.775315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.776094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.778035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.794731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1190/2414] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:30.798904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.811273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab736ae-d9f4-4aee-8bcf-a4131b3ba044 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.818372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.819324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.819681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.820043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.820940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.823867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.825139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.828463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:30.837009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1225/2415] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:30.839581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:30.852310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ce73c-4adb-4701-aeb5-7cb5e9e2a19a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.854266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d603ec-5aed-45b6-aac0-2e20f1797bb3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:30.857531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19978b04-42af-4298-a5e4-3be8ff2f06ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.858430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19978b04-42af-4298-a5e4-3be8ff2f06ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.858721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19978b04-42af-4298-a5e4-3be8ff2f06ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.858995 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19978b04-42af-4298-a5e4-3be8ff2f06ab admin admin] PATH_INFO: `/v3/projects/c49b71e32d0740e19c6c0ac76585f0af/users/3159f22d0068427c8a165d12e082087b/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.859292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:30.860321 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.860602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.860866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] PATH_INFO: `/v3/users/9c13ce02fca548c5b1186a536a2d4474` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.862065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c13ce02fca548c5b1186a536a2d4474)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.864452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.875566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19978b04-42af-4298-a5e4-3be8ff2f06ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49b71e32d0740e19c6c0ac76585f0af, user_id=3159f22d0068427c8a165d12e082087b, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:30.878288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19978b04-42af-4298-a5e4-3be8ff2f06ab admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:30.893425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1226/2416] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:30 2022] PUT /identity/v3/projects/c49b71e32d0740e19c6c0ac76585f0af/users/3159f22d0068427c8a165d12e082087b/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:30.907896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:30.908497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:30.908774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:30.912262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:30.928355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c13ce02fca548c5b1186a536a2d4474'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.929104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c13ce02fca548c5b1186a536a2d4474'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.929820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c13ce02fca548c5b1186a536a2d4474'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.945006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c13ce02fca548c5b1186a536a2d4474'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.945341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] MFA Rules not processed for user `3159f22d0068427c8a165d12e082087b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:30.947138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:30.952385 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c13ce02fca548c5b1186a536a2d4474'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:30.966616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1191/2417] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:30 2022] DELETE /identity/v3/users/9c13ce02fca548c5b1186a536a2d4474 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:31.024665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1227/2418] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:31.036981 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.038420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.102201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50511540-d020-4b42-90fc-d1075dce4c69 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.106331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.106998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.107776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.107776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.171670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.173208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.177008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.178924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.190442 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1192/2419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:31.211332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.213713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.261996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c878b2-09df-468b-a1ff-475e001ef724 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.289796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcc8ce-f883-49b4-b9c9-aa6e28c58e9c service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.294520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.295402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.295710 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.295970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] PATH_INFO: `/v3/users/3159f22d0068427c8a165d12e082087b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.297222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3159f22d0068427c8a165d12e082087b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.299293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.306421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:31.313400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:31.332865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.333782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.334071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.334355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] PATH_INFO: `/v3/projects/536b36bd517a4dca8706718f6bab9c1a` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.335674 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=536b36bd517a4dca8706718f6bab9c1a)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.337911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.364234 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3159f22d0068427c8a165d12e082087b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.366023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3159f22d0068427c8a165d12e082087b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.366679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3159f22d0068427c8a165d12e082087b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.383059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3159f22d0068427c8a165d12e082087b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.391427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-577515a8-578f-482e-b9b8-951098612578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3159f22d0068427c8a165d12e082087b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.398141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536b36bd517a4dca8706718f6bab9c1a', 'request_id': 'req-8ad74203-8190-4138-8c8e-be116041af9d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.404821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536b36bd517a4dca8706718f6bab9c1a', 'request_id': 'req-8ad74203-8190-4138-8c8e-be116041af9d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.408049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1193/2420] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:31 2022] DELETE /identity/v3/users/3159f22d0068427c8a165d12e082087b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:31.412778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.413094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.413409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.416137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536b36bd517a4dca8706718f6bab9c1a', 'request_id': 'req-8ad74203-8190-4138-8c8e-be116041af9d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.432133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] The token cache is being invalidate because project 536b36bd517a4dca8706718f6bab9c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:31.432620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.433437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8ad74203-8190-4138-8c8e-be116041af9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:31.435459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1228/2421] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:31 2022] DELETE /identity/v3/projects/536b36bd517a4dca8706718f6bab9c1a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:31.442641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429d5b-835f-4c13-b56e-6576894e3337 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.442877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:31.443204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429d5b-835f-4c13-b56e-6576894e3337 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.443839 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429d5b-835f-4c13-b56e-6576894e3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.444778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.464967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e2429d5b-835f-4c13-b56e-6576894e3337 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:31.467688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e2429d5b-835f-4c13-b56e-6576894e3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.521913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1194/2422] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:31.533599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.535018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.545261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1229/2423] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:31.554422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157030b-c154-440c-b35a-73b363c285f8 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.554422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157030b-c154-440c-b35a-73b363c285f8 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.555109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157030b-c154-440c-b35a-73b363c285f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.575513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0157030b-c154-440c-b35a-73b363c285f8 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:31.577146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0157030b-c154-440c-b35a-73b363c285f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.586318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1230/2424] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:31.590526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157030b-c154-440c-b35a-73b363c285f8 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.607376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157030b-c154-440c-b35a-73b363c285f8 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.608789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0df36-13b2-44b4-946d-6e4576a79444 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.612548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.612689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.613224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.613394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.614068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.614352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.614845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.615085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:31.615187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.615398 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.617048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.628391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.630130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.631477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1231/2425] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:20:31.636154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.640842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1195/2426] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:31.646030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4645fe-2911-4679-b19a-c1bc8e55d97f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.651099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.651540 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.651831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.652111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.652842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.654757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.687297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1232/2427] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:31 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:31.691713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.702029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f327a0-60bc-471a-8711-ced072b73330 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.730040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:31.765012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.765695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.765978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.766255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.766947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.768911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.794189 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1196/2428] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:31 2022] POST /identity/v3/users => generated 278 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:31.795652 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.806812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0e4b4-077b-407a-aa1b-94770493eba6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.811884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.812509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.812797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.813105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.813835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.815629 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.827347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1233/2429] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:31.831213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.845331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434816c-261f-442b-9ee2-bce3e44e4719 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.852082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.852753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.853049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.853271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.856443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.859438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.874725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1197/2430] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:31.884598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.894923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eef63c-86f0-4420-8853-db3f2f3817b3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.899757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4cd25c-9ea4-4521-947f-1c3229541cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:31.900687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cd25c-9ea4-4521-947f-1c3229541cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.900978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cd25c-9ea4-4521-947f-1c3229541cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.901280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4cd25c-9ea4-4521-947f-1c3229541cc3 admin admin] PATH_INFO: `/v3/projects/75361eaf13014a33937f508d54ad54ca/users/dbea8fb6b7be47b197cd15b7f4410c03/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.918333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cd25c-9ea4-4521-947f-1c3229541cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75361eaf13014a33937f508d54ad54ca, user_id=dbea8fb6b7be47b197cd15b7f4410c03, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:31.921242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4cd25c-9ea4-4521-947f-1c3229541cc3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:31.923456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:31.938009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1234/2431] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:31 2022] PUT /identity/v3/projects/75361eaf13014a33937f508d54ad54ca/users/dbea8fb6b7be47b197cd15b7f4410c03/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:31.941187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:31.943612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:31.952932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272a26-79d2-4685-87fe-478910da19f0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:31.953228 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272a26-79d2-4685-87fe-478910da19f0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:31.953508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62272a26-79d2-4685-87fe-478910da19f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:31.972373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893a302-bd21-47eb-89a5-8b6a56abd9cf admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:31.987268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-62272a26-79d2-4685-87fe-478910da19f0 None None] MFA Rules not processed for user `dbea8fb6b7be47b197cd15b7f4410c03`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:31.989662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-62272a26-79d2-4685-87fe-478910da19f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.054602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.055517 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.055799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.056072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] PATH_INFO: `/v3/projects/c49b71e32d0740e19c6c0ac76585f0af` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.057345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49b71e32d0740e19c6c0ac76585f0af)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.059291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.064321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1235/2432] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:31 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:32.069400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272a26-79d2-4685-87fe-478910da19f0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.080679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62272a26-79d2-4685-87fe-478910da19f0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.086509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.087209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.087489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.087768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.088595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.090639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.122761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49b71e32d0740e19c6c0ac76585f0af', 'request_id': 'req-6714dd25-9765-449f-8f22-d64dd1963a44'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:32.123617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1236/2433] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:32.127224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.130441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49b71e32d0740e19c6c0ac76585f0af', 'request_id': 'req-6714dd25-9765-449f-8f22-d64dd1963a44'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:32.138564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49b71e32d0740e19c6c0ac76585f0af', 'request_id': 'req-6714dd25-9765-449f-8f22-d64dd1963a44'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:32.152430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] The token cache is being invalidate because project c49b71e32d0740e19c6c0ac76585f0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:32.152967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:32.153899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-6714dd25-9765-449f-8f22-d64dd1963a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:32.155831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1198/2434] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:31 2022] DELETE /identity/v3/projects/c49b71e32d0740e19c6c0ac76585f0af => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:32.160950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9197-5260-44b8-818f-c53df4ac101d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.161384 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9197-5260-44b8-818f-c53df4ac101d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.161621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9197-5260-44b8-818f-c53df4ac101d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.180316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-52cf9197-5260-44b8-818f-c53df4ac101d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:32.181542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52cf9197-5260-44b8-818f-c53df4ac101d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.201852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4454-dd29-45fa-8aff-325eccacbfdc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.206883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.208145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.208596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.208882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.209584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.211521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.215557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:32.232648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1237/2435] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:32.236367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.238018 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.250718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1199/2436] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:32.252448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6156a-58b8-4822-ac96-715f4efb6e17 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.258327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.258684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01bef-29a4-4b86-b561-e7c5d0386092 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.258982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01bef-29a4-4b86-b561-e7c5d0386092 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.259302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.259510 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a01bef-29a4-4b86-b561-e7c5d0386092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.259767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.259767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.260305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.261966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.276091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1238/2437] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:32.277126 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.278244 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d4a01bef-29a4-4b86-b561-e7c5d0386092 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:32.279463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d4a01bef-29a4-4b86-b561-e7c5d0386092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.287873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7d502-42ab-49a5-a8fe-5e4fa1ceff8d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.288209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1200/2438] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:32.292210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01bef-29a4-4b86-b561-e7c5d0386092 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.292700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.293580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.293888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.294172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] PATH_INFO: `/v3/projects/3bfaf10fec4b4805b2d404c6d2d83185/users/e951efddec134a01be8f0347b775d1ad/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.301291 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a01bef-29a4-4b86-b561-e7c5d0386092 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.307655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.308348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.308639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.308915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.309656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:32.309971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.310762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfaf10fec4b4805b2d404c6d2d83185, user_id=e951efddec134a01be8f0347b775d1ad, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.311672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.313429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.324029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1201/2439] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:20:32.328199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1239/2440] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:32 2022] PUT /identity/v3/projects/3bfaf10fec4b4805b2d404c6d2d83185/users/e951efddec134a01be8f0347b775d1ad/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:32.328429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.331738 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.338736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51270b6-752e-4f29-8516-517596ad07ca admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.350332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:32.399762 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945027e9-e77c-4bf9-949b-1c60afa72550 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.403724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.404418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.404566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.404707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.405107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.405220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.405419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.405694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.405803 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.406412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.407697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.407987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.418862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1240/2441] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:32.422967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.435562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d54fc7-6538-4b5f-9a78-da3f934d738b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.440663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1202/2442] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:32.441562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.499658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaca910-f9ac-486b-b6f8-fd0957b80d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.500588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca910-f9ac-486b-b6f8-fd0957b80d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.500880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca910-f9ac-486b-b6f8-fd0957b80d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.501189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaca910-f9ac-486b-b6f8-fd0957b80d16 admin admin] PATH_INFO: `/v3/projects/3bfaf10fec4b4805b2d404c6d2d83185/users/e951efddec134a01be8f0347b775d1ad/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.503313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaca910-f9ac-486b-b6f8-fd0957b80d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfaf10fec4b4805b2d404c6d2d83185, user_id=e951efddec134a01be8f0347b775d1ad, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.506084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaca910-f9ac-486b-b6f8-fd0957b80d16 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.506502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c07cb-d6cd-4b49-9677-f0ece55d7952 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.511188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.511845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.512125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.512440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.513120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.515024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.516911 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1241/2443] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:32 2022] PUT /identity/v3/projects/3bfaf10fec4b4805b2d404c6d2d83185/users/e951efddec134a01be8f0347b775d1ad/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:32.527338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ef71-4f01-429b-9346-6285f6009079 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.527668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ef71-4f01-429b-9346-6285f6009079 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.527969 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6690ef71-4f01-429b-9346-6285f6009079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.537635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1203/2444] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:32.542129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.557051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6690ef71-4f01-429b-9346-6285f6009079 None None] MFA Rules not processed for user `e951efddec134a01be8f0347b775d1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:32.557394 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2689c-a984-4fe8-bd23-07f29ba23f98 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.558352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6690ef71-4f01-429b-9346-6285f6009079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.592083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:32.630250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.630942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.631224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.631503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.632261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.633883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.640615 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1242/2445] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:32.645277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1204/2446] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:32.649187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690ef71-4f01-429b-9346-6285f6009079 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.654974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.656647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.659660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6690ef71-4f01-429b-9346-6285f6009079 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.666333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.667238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.667630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.668014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.669089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.671444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.686616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1243/2447] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:32.690689 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.700518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f20543-4467-485d-a1ae-df1ab98ae3ad admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.705360 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e77bf9-313d-4bb3-95c5-bdc8311a83af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.706248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77bf9-313d-4bb3-95c5-bdc8311a83af admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.706531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77bf9-313d-4bb3-95c5-bdc8311a83af admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.706812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e77bf9-313d-4bb3-95c5-bdc8311a83af admin admin] PATH_INFO: `/v3/projects/5a623d1ac9e2475c8386349a3e9e3d8e/users/0b59069e68f8494c96be4d8f614a0bcb/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.715585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712bc08-0be2-452a-a948-6f1278e8d7eb admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.719548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.720221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.720504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.720781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.722614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e77bf9-313d-4bb3-95c5-bdc8311a83af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a623d1ac9e2475c8386349a3e9e3d8e, user_id=0b59069e68f8494c96be4d8f614a0bcb, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.726020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e77bf9-313d-4bb3-95c5-bdc8311a83af admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.729818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:32.731334 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.732761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.741767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1244/2448] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:32 2022] PUT /identity/v3/projects/5a623d1ac9e2475c8386349a3e9e3d8e/users/0b59069e68f8494c96be4d8f614a0bcb/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:32.743612 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1205/2449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:20:32.753441 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.753731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.754190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.782572 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] MFA Rules not processed for user `0b59069e68f8494c96be4d8f614a0bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:32.783819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.821890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.831408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3350fd-2a14-4b1e-95d3-189e61d083a9 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.863470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1245/2450] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:20:32.874670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:32.876558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.892460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.893118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.893402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.893679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.896136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:32.950484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133caf7-c870-46b1-86f3-6342aea4191e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:32.955451 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:32.956116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:32.956425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:32.956704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:32.968444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.968695 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:32.968805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.969568 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:32.981786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1246/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:20:32.984573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1206/2452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:32 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:20:33.199661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:33.212531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865ccf6-49ae-407b-bb52-865262843643 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:33.216302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2ad65-655a-4a88-b7a9-b77568d61fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:33.216939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2ad65-655a-4a88-b7a9-b77568d61fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:33.217225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2ad65-655a-4a88-b7a9-b77568d61fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:33.217503 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2ad65-655a-4a88-b7a9-b77568d61fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:33.219775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d3b2ad65-655a-4a88-b7a9-b77568d61fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:33.298613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2ad65-655a-4a88-b7a9-b77568d61fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:33.300492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2ad65-655a-4a88-b7a9-b77568d61fa1 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:33.314032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1247/2453] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:38.085276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:38.116732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:38.156509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be357-fa2a-4886-b0b6-d33edbd3849b service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:38.161263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:38.162040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:38.162324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:38.162601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] PATH_INFO: `/v3/users/0b59069e68f8494c96be4d8f614a0bcb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:38.163796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b59069e68f8494c96be4d8f614a0bcb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:38.165779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:38.214379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b59069e68f8494c96be4d8f614a0bcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.215036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b59069e68f8494c96be4d8f614a0bcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.215643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b59069e68f8494c96be4d8f614a0bcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.231146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b59069e68f8494c96be4d8f614a0bcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.240398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b59069e68f8494c96be4d8f614a0bcb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.252687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1207/2454] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:38 2022] DELETE /identity/v3/users/0b59069e68f8494c96be4d8f614a0bcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:38.258348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:38.258836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:38.259236 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:38.277743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:38.279076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:38.296255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:38.342878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1248/2455] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:38.353970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:38.355512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:38.419719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc98d-c249-4006-80f3-cc0c73574db7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:38.423805 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a77257-8875-4934-9a92-696044a2963d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:38.424661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77257-8875-4934-9a92-696044a2963d service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:38.424904 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77257-8875-4934-9a92-696044a2963d service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:38.425187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a77257-8875-4934-9a92-696044a2963d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:38.441221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a77257-8875-4934-9a92-696044a2963d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:38.442727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a77257-8875-4934-9a92-696044a2963d service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:38.452590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1208/2456] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:38.724874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:38.726451 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:38.739551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2362cfe1-eead-40fd-90da-af228be45929 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:38.744354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:38.745304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:38.745912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:38.746252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] PATH_INFO: `/v3/projects/5a623d1ac9e2475c8386349a3e9e3d8e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:38.747588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a623d1ac9e2475c8386349a3e9e3d8e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:38.749994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:38.797951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a623d1ac9e2475c8386349a3e9e3d8e', 'request_id': 'req-d01195cb-6d5b-4424-8485-9d3394c20e17'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.804238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a623d1ac9e2475c8386349a3e9e3d8e', 'request_id': 'req-d01195cb-6d5b-4424-8485-9d3394c20e17'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.811286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a623d1ac9e2475c8386349a3e9e3d8e', 'request_id': 'req-d01195cb-6d5b-4424-8485-9d3394c20e17'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.821713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] The token cache is being invalidate because project 5a623d1ac9e2475c8386349a3e9e3d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:38.822005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.822632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d01195cb-6d5b-4424-8485-9d3394c20e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:38.824165 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1249/2457] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:38 2022] DELETE /identity/v3/projects/5a623d1ac9e2475c8386349a3e9e3d8e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:38.829006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24532-8b3e-46c7-b1f0-88be426061a7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:38.829294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24532-8b3e-46c7-b1f0-88be426061a7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:38.829570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a24532-8b3e-46c7-b1f0-88be426061a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:38.847589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d4a24532-8b3e-46c7-b1f0-88be426061a7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:38.849416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d4a24532-8b3e-46c7-b1f0-88be426061a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:38.890699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:38.911054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1209/2458] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:38.920946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14cd1-3788-43fd-bc6f-d8af5e7d04f9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:38.921240 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14cd1-3788-43fd-bc6f-d8af5e7d04f9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:38.921522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da14cd1-3788-43fd-bc6f-d8af5e7d04f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:38.941264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4da14cd1-3788-43fd-bc6f-d8af5e7d04f9 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:38.942702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4da14cd1-3788-43fd-bc6f-d8af5e7d04f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:38.950804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1250/2459] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:38.954726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a24532-8b3e-46c7-b1f0-88be426061a7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:38.964980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a24532-8b3e-46c7-b1f0-88be426061a7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:38.969511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:38.970162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:38.970440 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:38.970712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:38.971430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:38.971774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:38.973972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:38.986368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1210/2460] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:20:38.990818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14cd1-3788-43fd-bc6f-d8af5e7d04f9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:39.004114 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da14cd1-3788-43fd-bc6f-d8af5e7d04f9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:39.008972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:39.009635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.009918 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.010218 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.010932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:39.012905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:39.040705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1251/2461] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:38 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:39.044821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:39.055079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543a79c-3268-4191-9586-147486fe0205 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:39.116480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:39.117263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.117535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.117809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.118504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:39.120700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:39.143463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1211/2462] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:39 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:39.146569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:39.157957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6068b43e-51f7-4b36-97f2-d2cb324f3f89 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:39.162882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:39.163542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.163822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.164125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.164940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:39.166586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:39.178185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1252/2463] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:39.182290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:39.193492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5c65-5ad5-4408-b05e-bdc94eea03c6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:39.198536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc4c910-e68c-406f-b73e-1fe1d0e9ad26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:39.199585 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c910-e68c-406f-b73e-1fe1d0e9ad26 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.200105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c910-e68c-406f-b73e-1fe1d0e9ad26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.200664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc4c910-e68c-406f-b73e-1fe1d0e9ad26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.202113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4c910-e68c-406f-b73e-1fe1d0e9ad26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:39.204622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc4c910-e68c-406f-b73e-1fe1d0e9ad26 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:39.215613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1212/2464] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:39.219770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:39.230532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f0c4e-43d3-4e80-8022-fa0150da4be1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:39.235141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:39.236051 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.236364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.236640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] PATH_INFO: `/v3/projects/404175dcaa0144fab98ad34e4834de35/users/105646575b4748a88700db4117174c0c/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.251898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=404175dcaa0144fab98ad34e4834de35, user_id=105646575b4748a88700db4117174c0c, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:39.255891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:39.268294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1253/2465] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:39 2022] PUT /identity/v3/projects/404175dcaa0144fab98ad34e4834de35/users/105646575b4748a88700db4117174c0c/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:39.274616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30deac-a393-4776-b528-6a9d2017508b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.274986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30deac-a393-4776-b528-6a9d2017508b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.275277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e30deac-a393-4776-b528-6a9d2017508b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.293598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2e30deac-a393-4776-b528-6a9d2017508b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:39.294796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2e30deac-a393-4776-b528-6a9d2017508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:39.372233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1213/2466] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:39.381941 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:39.386181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:39.454898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:39.472070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0398-d393-4dc6-83cf-20316cf5d0fe admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:39.479504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a78f9-9496-4515-8df4-825ea66ff47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:39.480810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a78f9-9496-4515-8df4-825ea66ff47e service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.480810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a78f9-9496-4515-8df4-825ea66ff47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.480810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a78f9-9496-4515-8df4-825ea66ff47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.491158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a78f9-9496-4515-8df4-825ea66ff47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:39.492751 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a78f9-9496-4515-8df4-825ea66ff47e service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:39.506099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1254/2467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:39.574632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:39.574924 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:39.575204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:39.597470 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] MFA Rules not processed for user `236f49a4117f488ea8bf5c523fadadc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:39.599989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:39.665719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:39.700514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1214/2468] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:40.267684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c339d-f7fb-4ae9-815d-c13d46bc1a06 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:40.267975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c339d-f7fb-4ae9-815d-c13d46bc1a06 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:40.268479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c339d-f7fb-4ae9-815d-c13d46bc1a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:40.297407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bc0c339d-f7fb-4ae9-815d-c13d46bc1a06 None None] MFA Rules not processed for user `105646575b4748a88700db4117174c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:40.298650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bc0c339d-f7fb-4ae9-815d-c13d46bc1a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:40.377458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1255/2469] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:40.389633 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:40.391086 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:40.460402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca6852-af9d-452a-9d2c-c46168c4e396 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:40.463879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:40.469884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:40.470198 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:40.470495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:40.485344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:40.486787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:40.501168 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1215/2470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:43.037415 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa564c5-1317-4532-ae95-c27ccda186ae None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:43.038015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa564c5-1317-4532-ae95-c27ccda186ae None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:43.038015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa564c5-1317-4532-ae95-c27ccda186ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:43.056303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8aa564c5-1317-4532-ae95-c27ccda186ae None None] MFA Rules not processed for user `105646575b4748a88700db4117174c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:43.057470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8aa564c5-1317-4532-ae95-c27ccda186ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:43.064448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1256/2471] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:50.492944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=27 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:53.050174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=42 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:55.056266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:55.057779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:55.072766 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7452199-9f32-4f2c-92ce-89e370134a4c service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:55.079043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:55.080015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:55.080242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:55.080524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] PATH_INFO: `/v3/users/dbea8fb6b7be47b197cd15b7f4410c03` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:55.081910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbea8fb6b7be47b197cd15b7f4410c03)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:55.084135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:55.140454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbea8fb6b7be47b197cd15b7f4410c03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.141119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbea8fb6b7be47b197cd15b7f4410c03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.141987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbea8fb6b7be47b197cd15b7f4410c03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.159943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbea8fb6b7be47b197cd15b7f4410c03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.170756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbea8fb6b7be47b197cd15b7f4410c03'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.191357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1216/2472] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:55 2022] DELETE /identity/v3/users/dbea8fb6b7be47b197cd15b7f4410c03 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:55.193793 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:55.194764 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:55.195049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:55.216847 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:55.218054 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:55.287924 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1257/2473] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:55.297478 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:55.299063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:55.359260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e114249-30b0-40bf-918b-f8bb569ae706 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:55.363072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:55.363730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:55.364782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:55.365022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:55.375195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:55.376694 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:55.387524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1217/2474] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:55.697540 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:55.699135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:55.714872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd9a57-86de-4c1b-a619-107634f8a2db None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:55.721160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:55.722179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:55.722563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:55.722937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] PATH_INFO: `/v3/projects/75361eaf13014a33937f508d54ad54ca` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:55.724435 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75361eaf13014a33937f508d54ad54ca)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:55.728455 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:55.791472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75361eaf13014a33937f508d54ad54ca', 'request_id': 'req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.799651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75361eaf13014a33937f508d54ad54ca', 'request_id': 'req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.818758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75361eaf13014a33937f508d54ad54ca', 'request_id': 'req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.836479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] The token cache is being invalidate because project 75361eaf13014a33937f508d54ad54ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:55.836937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.837983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:55.843606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1258/2475] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:55 2022] DELETE /identity/v3/projects/75361eaf13014a33937f508d54ad54ca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:55.844060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:55.856677 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d133-3013-42e3-81c2-beadca7a7ca8 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:55.904804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:55.906439 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:55.931224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:55.931873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:55.932167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:55.932460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] PATH_INFO: `/v3/users/e951efddec134a01be8f0347b775d1ad` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:55.934272 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e951efddec134a01be8f0347b775d1ad)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:55.936817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:55.969869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:55.977044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b323bb7-65ee-4dfb-93f6-4912a3fdb046 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:55.983403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:55.984471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:55.984845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:55.985117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:55.988033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:56.004007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:56.005508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:56.011352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e951efddec134a01be8f0347b775d1ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.012027 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e951efddec134a01be8f0347b775d1ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.012669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e951efddec134a01be8f0347b775d1ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.016873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1259/2476] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:56.026053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e951efddec134a01be8f0347b775d1ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.036845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-87d8f5eb-8922-48d3-bb50-6076824c807f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e951efddec134a01be8f0347b775d1ad'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.049821 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1218/2477] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:55 2022] DELETE /identity/v3/users/e951efddec134a01be8f0347b775d1ad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:56.336099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:56.337766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:56.364679 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aca2430-c009-4e95-8a38-950d5eb21d27 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:56.397777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:56.440939 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:56.441828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:56.442134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:56.442409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] PATH_INFO: `/v3/projects/3bfaf10fec4b4805b2d404c6d2d83185` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:56.443634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfaf10fec4b4805b2d404c6d2d83185)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:56.445616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:56.513113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfaf10fec4b4805b2d404c6d2d83185', 'request_id': 'req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.520989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfaf10fec4b4805b2d404c6d2d83185', 'request_id': 'req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.532400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfaf10fec4b4805b2d404c6d2d83185', 'request_id': 'req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.548458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] The token cache is being invalidate because project 3bfaf10fec4b4805b2d404c6d2d83185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:20:56.549389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.550253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7ec66f88-a3fb-40ee-b5fa-3b63218d3e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:56.554008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1260/2478] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:20:56 2022] DELETE /identity/v3/projects/3bfaf10fec4b4805b2d404c6d2d83185 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:56.558947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69b32-8cfd-4e3e-a35c-e0f1bbe61f4c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:56.560019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69b32-8cfd-4e3e-a35c-e0f1bbe61f4c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:56.560553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c69b32-8cfd-4e3e-a35c-e0f1bbe61f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:56.587351 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8c69b32-8cfd-4e3e-a35c-e0f1bbe61f4c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:56.589768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8c69b32-8cfd-4e3e-a35c-e0f1bbe61f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:56.723490 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1219/2479] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:56.724725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5b932-648d-43fc-a250-4a264ec971d0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:56.725022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5b932-648d-43fc-a250-4a264ec971d0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:56.725427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5b932-648d-43fc-a250-4a264ec971d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:56.748322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8da5b932-648d-43fc-a250-4a264ec971d0 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:56.749603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8da5b932-648d-43fc-a250-4a264ec971d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:56.762344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1261/2480] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:56.766750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69b32-8cfd-4e3e-a35c-e0f1bbe61f4c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:56.780339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c69b32-8cfd-4e3e-a35c-e0f1bbe61f4c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:56.787849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:56.787849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:56.787849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:56.787849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:56.789188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:20:56.789573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:56.791318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:56.812348 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1220/2481] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:20:56.813091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5b932-648d-43fc-a250-4a264ec971d0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:56.824110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5b932-648d-43fc-a250-4a264ec971d0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:56.831029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:56.831807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:56.832187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:56.832442 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:56.834072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:56.836992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:56.869774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1262/2482] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:56 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:56.874290 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:56.886265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3ca18-15c1-482b-a7b8-354e06fe9d87 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:56.947608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:56.948315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:56.948595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:56.948910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:56.949570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:56.951479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:56.972868 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1221/2483] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:56 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:56.978381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:56.990186 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b757a-b910-4a7c-839a-c69b0cafa545 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:56.996371 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:56.997055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:56.997299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:56.997734 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:56.998628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.000302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.011341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1263/2484] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:57.015565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.028194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac55ee-7385-44fe-be67-510cbccb059e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.033836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498ab0f-9945-46c4-a09d-ac0e8fc5c3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.034680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498ab0f-9945-46c4-a09d-ac0e8fc5c3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.034969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498ab0f-9945-46c4-a09d-ac0e8fc5c3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.035295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498ab0f-9945-46c4-a09d-ac0e8fc5c3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.037011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498ab0f-9945-46c4-a09d-ac0e8fc5c3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.038876 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498ab0f-9945-46c4-a09d-ac0e8fc5c3d2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.045378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:57.053535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1222/2485] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:57.058134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.072009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e821-0b22-421a-b046-fde0126b9649 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.077159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.078149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.078432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.078708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] PATH_INFO: `/v3/projects/9fc7566108934a77b0de0ea995e4fa66/users/85a86f52da0144cba33609ac05b9f95d/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.096011 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc7566108934a77b0de0ea995e4fa66, user_id=85a86f52da0144cba33609ac05b9f95d, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.099270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.114136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1264/2486] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:57 2022] PUT /identity/v3/projects/9fc7566108934a77b0de0ea995e4fa66/users/85a86f52da0144cba33609ac05b9f95d/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:57.124787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217d06-d368-4a5e-87e6-39990ce4717f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.125078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217d06-d368-4a5e-87e6-39990ce4717f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.125358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79217d06-d368-4a5e-87e6-39990ce4717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.154423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-79217d06-d368-4a5e-87e6-39990ce4717f None None] MFA Rules not processed for user `85a86f52da0144cba33609ac05b9f95d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:57.155644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-79217d06-d368-4a5e-87e6-39990ce4717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:57.227754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1223/2487] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:57.232798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.292378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:57.301958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b5b6a-9c2b-4190-ab44-a4d8ca0fea97 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.308133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.309176 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.309631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.310103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.311039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.313297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.344425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1265/2488] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:20:57 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:20:57.345697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217d06-d368-4a5e-87e6-39990ce4717f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.357148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79217d06-d368-4a5e-87e6-39990ce4717f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.445740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.446438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.446716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.447143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.447912 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.450343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.480252 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1224/2489] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:20:57 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:20:57.481329 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.493895 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963428-2c6b-40ce-853a-98f81d85584c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.499274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.499985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.500301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.500580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.501317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.502927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.521445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1266/2490] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:20:57.522535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.533209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b25ac3-f9d1-4778-9585-3bac3ae491b3 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.539154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.540069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.540393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.540668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] PATH_INFO: `/v3/projects/b03781ed3975444ca4cff57d95fe6b9c/users/e705ed65d01f4d9ebdb57fbe2e8452fe/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.557145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03781ed3975444ca4cff57d95fe6b9c, user_id=e705ed65d01f4d9ebdb57fbe2e8452fe, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.559907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.574479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1225/2491] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:57 2022] PUT /identity/v3/projects/b03781ed3975444ca4cff57d95fe6b9c/users/e705ed65d01f4d9ebdb57fbe2e8452fe/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:57.578530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.593266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419700a-f1f5-4081-a6bf-a4291649280d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.655027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d19ccf-c307-4718-a313-3408e2e291eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.655755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d19ccf-c307-4718-a313-3408e2e291eb admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.656039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d19ccf-c307-4718-a313-3408e2e291eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.656352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d19ccf-c307-4718-a313-3408e2e291eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.657088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d19ccf-c307-4718-a313-3408e2e291eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.658690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d19ccf-c307-4718-a313-3408e2e291eb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.672062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1267/2492] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:20:57.673279 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.684593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80692-5d79-40c4-adfb-c9b5c57a9560 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.690144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.691076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.691359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.691633 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] PATH_INFO: `/v3/projects/b03781ed3975444ca4cff57d95fe6b9c/users/e705ed65d01f4d9ebdb57fbe2e8452fe/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.693841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03781ed3975444ca4cff57d95fe6b9c, user_id=e705ed65d01f4d9ebdb57fbe2e8452fe, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.696551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.708289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1226/2493] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:20:57 2022] PUT /identity/v3/projects/b03781ed3975444ca4cff57d95fe6b9c/users/e705ed65d01f4d9ebdb57fbe2e8452fe/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:20:57.718320 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5736d-aadf-4586-bbf6-05d5cf4937ba None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.718613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5736d-aadf-4586-bbf6-05d5cf4937ba None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.718896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5736d-aadf-4586-bbf6-05d5cf4937ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.746795 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1de5736d-aadf-4586-bbf6-05d5cf4937ba None None] MFA Rules not processed for user `e705ed65d01f4d9ebdb57fbe2e8452fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:57.747936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1de5736d-aadf-4586-bbf6-05d5cf4937ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:57.819766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1268/2494] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:57.833309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:57.835260 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:57.889355 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:57.906851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1e85-d5da-488b-b309-54988940494d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:57.911597 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:57.912519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:57.912809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:57.913213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:57.925188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:57.927005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:57.939930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1227/2495] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:58.058636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5736d-aadf-4586-bbf6-05d5cf4937ba None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:58.069759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5736d-aadf-4586-bbf6-05d5cf4937ba None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:58.074016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3091db-fa02-421c-b957-baf803bdba75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:58.074742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3091db-fa02-421c-b957-baf803bdba75 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:58.075099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3091db-fa02-421c-b957-baf803bdba75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:58.075448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3091db-fa02-421c-b957-baf803bdba75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:58.129244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:20:58.144685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3091db-fa02-421c-b957-baf803bdba75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:58.147668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3091db-fa02-421c-b957-baf803bdba75 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:58.158266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1269/2496] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:20:59.115250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:59.117046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:59.201396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a445326-0bd6-43b5-a522-ae6dee504752 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:59.206350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:59.207366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:59.208236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:59.208508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] PATH_INFO: `/v3/users/bd1b7dde71ed41c189fc8fa4cdf966e3` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:59.209737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd1b7dde71ed41c189fc8fa4cdf966e3)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:59.211675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:59.260797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd1b7dde71ed41c189fc8fa4cdf966e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:59.261462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd1b7dde71ed41c189fc8fa4cdf966e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:59.262080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd1b7dde71ed41c189fc8fa4cdf966e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:59.276506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd1b7dde71ed41c189fc8fa4cdf966e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:59.286304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd1b7dde71ed41c189fc8fa4cdf966e3'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:20:59.298997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1228/2497] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:20:59 2022] DELETE /identity/v3/users/bd1b7dde71ed41c189fc8fa4cdf966e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:20:59.303892 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:59.304427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:59.304822 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:59.339225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:20:59.340480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:59.455440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1270/2498] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:20:59.465341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:20:59.467475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:20:59.571712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951775b-ee18-485b-9061-de62b47c968d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:20:59.577406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:20:59.578460 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:20:59.578817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:20:59.580012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:20:59.614826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:20:59.617820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:20:59.635159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1229/2499] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:20:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:00.162281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:00.163644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:00.164203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:00.166457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:00.180754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eebe25-6636-4a72-b585-144c7b8ebf59 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:00.187894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:00.189113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.189399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.189678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] PATH_INFO: `/v3/projects/54f0d8d4728b49f0b886518bc36933a1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.190886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54f0d8d4728b49f0b886518bc36933a1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:00.193041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:00.193194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88a2e1-9645-4f34-b001-b656c88000ab None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:00.195420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:00.202647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:00.203551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.203833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.204110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] PATH_INFO: `/v3/users/8cc395fc4407473e9595bc99c6b6b36c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.205382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cc395fc4407473e9595bc99c6b6b36c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:00.207356 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:00.247262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54f0d8d4728b49f0b886518bc36933a1', 'request_id': 'req-b7639fda-17dc-49e7-b58f-1f15b15b73a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.254813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54f0d8d4728b49f0b886518bc36933a1', 'request_id': 'req-b7639fda-17dc-49e7-b58f-1f15b15b73a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.261003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cc395fc4407473e9595bc99c6b6b36c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.261811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cc395fc4407473e9595bc99c6b6b36c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.262526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cc395fc4407473e9595bc99c6b6b36c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.265180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54f0d8d4728b49f0b886518bc36933a1', 'request_id': 'req-b7639fda-17dc-49e7-b58f-1f15b15b73a1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.274691 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cc395fc4407473e9595bc99c6b6b36c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.276719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] The token cache is being invalidate because project 54f0d8d4728b49f0b886518bc36933a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:00.277012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.277649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.279278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1230/2500] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:00 2022] DELETE /identity/v3/projects/54f0d8d4728b49f0b886518bc36933a1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:00.282260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cc395fc4407473e9595bc99c6b6b36c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.283142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:00.284640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:00.296667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1271/2501] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:00 2022] DELETE /identity/v3/users/8cc395fc4407473e9595bc99c6b6b36c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:00.360595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7639fda-17dc-49e7-b58f-1f15b15b73a1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:00.419594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:00.420530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.420806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.421079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] PATH_INFO: `/v3/users/be178b38b02245bfbb545a043a4b4604` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.422292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be178b38b02245bfbb545a043a4b4604)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:00.424521 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:00.468748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:00.477054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be178b38b02245bfbb545a043a4b4604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.477975 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be178b38b02245bfbb545a043a4b4604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.478828 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be178b38b02245bfbb545a043a4b4604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.491660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be178b38b02245bfbb545a043a4b4604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.498846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-cd0a21da-593a-4a7b-a7fd-b87c0fb9e218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be178b38b02245bfbb545a043a4b4604'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.511922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1231/2502] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:00 2022] DELETE /identity/v3/users/be178b38b02245bfbb545a043a4b4604 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:00.557906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:00.560516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:00.589215 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf6a4a-cc50-47b9-b234-c8bf67af0159 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:00.659161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:00.660029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.660350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.660635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] PATH_INFO: `/v3/projects/8fd2e5ab99c341d38c3f78dc17c0faf2` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.662586 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd2e5ab99c341d38c3f78dc17c0faf2)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:00.664432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:00.666019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:00.721937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'request_id': 'req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.729180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'request_id': 'req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.738078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd2e5ab99c341d38c3f78dc17c0faf2', 'request_id': 'req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.748799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] The token cache is being invalidate because project 8fd2e5ab99c341d38c3f78dc17c0faf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:00.749083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.749710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:00.751298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1272/2503] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:00 2022] DELETE /identity/v3/projects/8fd2e5ab99c341d38c3f78dc17c0faf2 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:00.756595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c30db-5014-4287-8203-8219bf24f7b1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.756880 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c30db-5014-4287-8203-8219bf24f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.757150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c30db-5014-4287-8203-8219bf24f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.776031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6f5c30db-5014-4287-8203-8219bf24f7b1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:00.777405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6f5c30db-5014-4287-8203-8219bf24f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:00.824777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:00.827335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:00.867531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1232/2504] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:00.880065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633fce-c878-48d3-a67f-d064cd041af7 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.880566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633fce-c878-48d3-a67f-d064cd041af7 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.881008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8633fce-c878-48d3-a67f-d064cd041af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.910073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8633fce-c878-48d3-a67f-d064cd041af7 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:00.911424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8633fce-c878-48d3-a67f-d064cd041af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:00.921639 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1233/2505] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:00.925902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633fce-c878-48d3-a67f-d064cd041af7 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:00.936040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8633fce-c878-48d3-a67f-d064cd041af7 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:00.940856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:00.941513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.944226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.944226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.944226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:00.944226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:00.945233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:00.949672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4abb61-ffc2-4313-b7c6-b990f8ed43a3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:00.956749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:00.961432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1234/2506] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:21:00.961589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.961589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.961589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] PATH_INFO: `/v3/projects/edfd4c799066454b9d8bd9e04a480595` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.961589 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edfd4c799066454b9d8bd9e04a480595)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:00.962272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:00.962640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:00.975247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02976f51-b398-4f3e-a6ce-66483298900d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:00.980080 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:00.980772 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:00.981051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:00.981469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:00.982167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:00.984055 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.016737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1235/2507] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:00 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:01.020663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edfd4c799066454b9d8bd9e04a480595', 'request_id': 'req-ba3b5626-b50e-4135-8162-c1109012dd37'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:01.021223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.026993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edfd4c799066454b9d8bd9e04a480595', 'request_id': 'req-ba3b5626-b50e-4135-8162-c1109012dd37'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:01.036777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edfd4c799066454b9d8bd9e04a480595', 'request_id': 'req-ba3b5626-b50e-4135-8162-c1109012dd37'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:01.055660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] The token cache is being invalidate because project edfd4c799066454b9d8bd9e04a480595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:01.055955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:01.056778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ba3b5626-b50e-4135-8162-c1109012dd37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:01.058388 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1273/2508] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:00 2022] DELETE /identity/v3/projects/edfd4c799066454b9d8bd9e04a480595 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:01.063328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4b15-8b06-492b-a417-2b1d87fc9e53 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.064208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4b15-8b06-492b-a417-2b1d87fc9e53 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.064208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4b15-8b06-492b-a417-2b1d87fc9e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.085179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-73db4b15-8b06-492b-a417-2b1d87fc9e53 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:01.086488 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-73db4b15-8b06-492b-a417-2b1d87fc9e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:01.100909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:01.112668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4591a0a-af7b-4eff-857f-fa33f69ca7fd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.118770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.119480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.119858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.120229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.121278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.123418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.148795 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1236/2509] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:01.149849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.152005 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:01.161574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:01.164806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1274/2510] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:01.166277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4775b2-9611-4466-872c-3cee7ca8341d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.166514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afba39a-9b5d-4ba1-a257-28ffc68adb2c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.166998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4775b2-9611-4466-872c-3cee7ca8341d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.166998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4775b2-9611-4466-872c-3cee7ca8341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.173807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.175196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.175196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.175431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.176201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.178779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.187816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9a4775b2-9611-4466-872c-3cee7ca8341d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:01.189163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9a4775b2-9611-4466-872c-3cee7ca8341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:01.193070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1237/2511] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:01.198238 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.198763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1275/2512] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:01.202714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4775b2-9611-4466-872c-3cee7ca8341d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.209133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f771bd-976b-486f-bea9-7d36e60a5cb4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.213291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4775b2-9611-4466-872c-3cee7ca8341d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.214215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.214900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.215184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.215461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.216296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.217943 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.219015 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.219789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.220142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.220713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.221278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:01.221593 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.223731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.230672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1238/2513] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:01.234867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.237443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1276/2514] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:21:01.241960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.246347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53d47d-cf71-4447-bcca-1be5878c8616 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.252492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.253507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.253706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d709f9-221f-4f7c-84d2-ef19368c05f6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.253863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.254150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] PATH_INFO: `/v3/projects/5f786493fa40450098fa4b94b1c26214/users/7a5d65765c6d4bb9a0e65ebf7c63370b/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.259517 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb7c8-414e-459c-9163-f81b16556953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.259935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb7c8-414e-459c-9163-f81b16556953 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.260246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb7c8-414e-459c-9163-f81b16556953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.260531 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb7c8-414e-459c-9163-f81b16556953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.261231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbb7c8-414e-459c-9163-f81b16556953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.263209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbb7c8-414e-459c-9163-f81b16556953 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.273188 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f786493fa40450098fa4b94b1c26214, user_id=7a5d65765c6d4bb9a0e65ebf7c63370b, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.277640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.295590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1277/2515] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:01.305376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1239/2516] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:01 2022] PUT /identity/v3/projects/5f786493fa40450098fa4b94b1c26214/users/7a5d65765c6d4bb9a0e65ebf7c63370b/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:01.305376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.306932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.307274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.307605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.336115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] MFA Rules not processed for user `7a5d65765c6d4bb9a0e65ebf7c63370b`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:01.337367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:01.369427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb2ad-ea18-44c2-9aff-bb81ec837e10 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.418740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1278/2517] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:01.433124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.435109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:01.449557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.450383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.450721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.451059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.451815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.454222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.476763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1240/2518] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:01.481033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.495069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea0dc0-3edc-49d5-a40c-9cba4399d30a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.501432 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.502126 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.502410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.502689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.503538 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.505848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.517564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1241/2519] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:01.521667 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19feb200-6858-4c63-91bd-16c3f41118cd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.522010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.529804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.529804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.529804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.529804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.535092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:01.537152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8531d-32b4-4595-a64a-40796d1df263 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.541285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.542314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86a3b9-b966-4712-96b6-fdfcaa0a76e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.542980 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86a3b9-b966-4712-96b6-fdfcaa0a76e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.543258 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86a3b9-b966-4712-96b6-fdfcaa0a76e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.543359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.543537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86a3b9-b966-4712-96b6-fdfcaa0a76e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.544457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86a3b9-b966-4712-96b6-fdfcaa0a76e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.546711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af86a3b9-b966-4712-96b6-fdfcaa0a76e8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.555665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1279/2520] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:01.558911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1242/2521] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:01.563013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.573494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112141-5b79-42cf-b83a-941ea6856dc4 service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.578166 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.579057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.579342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.579623 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] PATH_INFO: `/v3/projects/9306fa49b1fd4a29b7ded95dd4a202a7/users/788301e293d24c768104c3bbcfdc907b/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.611569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9306fa49b1fd4a29b7ded95dd4a202a7, user_id=788301e293d24c768104c3bbcfdc907b, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.611569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.627976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1280/2522] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:01 2022] PUT /identity/v3/projects/9306fa49b1fd4a29b7ded95dd4a202a7/users/788301e293d24c768104c3bbcfdc907b/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:01.639108 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768884d-e08b-4e78-9e8e-5c49955a032d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.639457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768884d-e08b-4e78-9e8e-5c49955a032d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.639741 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768884d-e08b-4e78-9e8e-5c49955a032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.694571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0768884d-e08b-4e78-9e8e-5c49955a032d None None] MFA Rules not processed for user `788301e293d24c768104c3bbcfdc907b`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:01.695938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0768884d-e08b-4e78-9e8e-5c49955a032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:01.735221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:01.814884 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1243/2523] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:01.819947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.821492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768884d-e08b-4e78-9e8e-5c49955a032d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.906877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484b6f3-9ce9-448e-b960-e844e63fc6d7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.909201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768884d-e08b-4e78-9e8e-5c49955a032d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:01.912028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.912731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.913009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.913281 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.913994 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.915870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.916581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:01.917970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:01.918433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:01.919013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] PATH_INFO: `/v3/users/7a5d65765c6d4bb9a0e65ebf7c63370b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:01.920870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5d65765c6d4bb9a0e65ebf7c63370b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:01.924525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:01.945887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1281/2524] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:01.951425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:01.986036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5d65765c6d4bb9a0e65ebf7c63370b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:01.986819 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5d65765c6d4bb9a0e65ebf7c63370b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:01.987400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5d65765c6d4bb9a0e65ebf7c63370b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.000421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5d65765c6d4bb9a0e65ebf7c63370b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.008956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ae02736f-fa32-4344-8af5-008b35f29df0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5d65765c6d4bb9a0e65ebf7c63370b'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.020604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee3351-4904-4986-b76b-cc4c80964666 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.021427 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1244/2525] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:01 2022] DELETE /identity/v3/users/7a5d65765c6d4bb9a0e65ebf7c63370b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:02.025850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.026139 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.026417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.043116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:02.044360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.079151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.079851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.080129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.080506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.081193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.083899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.085020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:02.092993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:02.110288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1282/2526] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:01 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:02.111705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1245/2527] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:02.115604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.117354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.121670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.123799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.129912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5f0fa-f61d-408a-a08a-01644ba25cff admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.134569 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.135259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.135538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.135812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.136610 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.138192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.149301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1283/2528] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:02.153419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.164845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b777ded-b87e-4caa-a1e3-aa7099eb1dcd admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.170194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.171524 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.171997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.172475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.173212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.175227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.187432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1284/2529] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:02.191731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.195230 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6418cd-2a8f-4a3e-a35e-b0d71cd121e3 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.199955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f45e5-81a3-487a-adad-6fa54cef205f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.200659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f45e5-81a3-487a-adad-6fa54cef205f service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.200938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f45e5-81a3-487a-adad-6fa54cef205f service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.201209 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f45e5-81a3-487a-adad-6fa54cef205f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.203424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883c9a2-b133-46bc-aa10-98a3054a728d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.209344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.210401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.210741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.211091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] PATH_INFO: `/v3/projects/d51603b34c0f45fabd01976ba3b83ace/users/d3ce23d32ed9432ba41583bb522cbab0/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.212040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f45e5-81a3-487a-adad-6fa54cef205f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.213551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f45e5-81a3-487a-adad-6fa54cef205f service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.223685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1246/2530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:02.227090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51603b34c0f45fabd01976ba3b83ace, user_id=d3ce23d32ed9432ba41583bb522cbab0, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.229919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.244245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1285/2531] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:02 2022] PUT /identity/v3/projects/d51603b34c0f45fabd01976ba3b83ace/users/d3ce23d32ed9432ba41583bb522cbab0/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:02.254606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb43d9-fd03-4d96-be45-df8a627c95fa None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.255111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb43d9-fd03-4d96-be45-df8a627c95fa None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.255506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fb43d9-fd03-4d96-be45-df8a627c95fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.284014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8fb43d9-fd03-4d96-be45-df8a627c95fa None None] MFA Rules not processed for user `d3ce23d32ed9432ba41583bb522cbab0`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:02.285289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8fb43d9-fd03-4d96-be45-df8a627c95fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.353362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1247/2532] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:02.358480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.438492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9c762f-6fec-4ff7-861d-226561d5f046 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.443317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.444052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.444459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.444953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.445774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.447682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.473928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1286/2533] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:02.477959 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb43d9-fd03-4d96-be45-df8a627c95fa None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.488569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fb43d9-fd03-4d96-be45-df8a627c95fa None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.544546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.546477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.558374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.559189 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.559482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.559761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.564353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.566481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.593393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1248/2534] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:02.594552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.603146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:02.607498 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96530a68-7209-480b-bb21-be0bf43718ee admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.614461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.615122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.615519 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.615794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.616645 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.618240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.619029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fde769-164b-43d4-b220-2013e5ed312a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.623998 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.624899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.625188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.625471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] PATH_INFO: `/v3/projects/5f786493fa40450098fa4b94b1c26214` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.626657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f786493fa40450098fa4b94b1c26214)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.628599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.628982 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1249/2535] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:02.633653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.643376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adbcdf-12ed-444c-b5af-945d071dcf10 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.648557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.649454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.649737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.650022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] PATH_INFO: `/v3/projects/2567d1ba237240adb803c46e4f514006/users/8f23b9d7de134b599abefb085bb3abc9/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.667971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:02.668787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2567d1ba237240adb803c46e4f514006, user_id=8f23b9d7de134b599abefb085bb3abc9, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.671863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.685697 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f786493fa40450098fa4b94b1c26214', 'request_id': 'req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.693659 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1250/2536] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:02 2022] PUT /identity/v3/projects/2567d1ba237240adb803c46e4f514006/users/8f23b9d7de134b599abefb085bb3abc9/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:02.693859 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f786493fa40450098fa4b94b1c26214', 'request_id': 'req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.698180 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.702748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f786493fa40450098fa4b94b1c26214', 'request_id': 'req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.716322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] The token cache is being invalidate because project 5f786493fa40450098fa4b94b1c26214 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:02.716614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.717292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1255c55a-2fbd-4c36-9d6b-ebdca6993c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:02.718885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1287/2537] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:02 2022] DELETE /identity/v3/projects/5f786493fa40450098fa4b94b1c26214 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:02.724905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3551a-c1c9-4476-880e-4ad97799b5d4 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.725308 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3551a-c1c9-4476-880e-4ad97799b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.725964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3551a-c1c9-4476-880e-4ad97799b5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.748066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d3f3551a-c1c9-4476-880e-4ad97799b5d4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:02.749534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d3f3551a-c1c9-4476-880e-4ad97799b5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.772939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea06204-9f77-44ee-b292-ee43c533c1b8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.779036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.779950 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.780267 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.780548 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.781293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.782919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.794804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1251/2538] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:02.798872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.801339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.815249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1d395-b2f7-4f76-b86b-18c533d776e4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.820530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b312be6-82a6-47c9-97f1-abc3916928ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.821547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b312be6-82a6-47c9-97f1-abc3916928ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.821698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b312be6-82a6-47c9-97f1-abc3916928ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.821972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b312be6-82a6-47c9-97f1-abc3916928ea admin admin] PATH_INFO: `/v3/projects/2567d1ba237240adb803c46e4f514006/users/8f23b9d7de134b599abefb085bb3abc9/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.822960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1288/2539] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:02.824514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b312be6-82a6-47c9-97f1-abc3916928ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2567d1ba237240adb803c46e4f514006, user_id=8f23b9d7de134b599abefb085bb3abc9, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.827184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b312be6-82a6-47c9-97f1-abc3916928ea admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.831002 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c83df-25e3-4f19-9b6e-df507a231464 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.836492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c83df-25e3-4f19-9b6e-df507a231464 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.836875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c83df-25e3-4f19-9b6e-df507a231464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.843974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1252/2540] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:02 2022] PUT /identity/v3/projects/2567d1ba237240adb803c46e4f514006/users/8f23b9d7de134b599abefb085bb3abc9/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:02.855949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.856268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.856547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.863128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e20c83df-25e3-4f19-9b6e-df507a231464 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:02.865365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e20c83df-25e3-4f19-9b6e-df507a231464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.905801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] MFA Rules not processed for user `8f23b9d7de134b599abefb085bb3abc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:02.908015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:02.939725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1289/2541] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:02.944657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c83df-25e3-4f19-9b6e-df507a231464 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.956570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c83df-25e3-4f19-9b6e-df507a231464 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:02.962636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:02.963386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:02.963673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:02.963948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:02.964714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:02.965024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:02.966633 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:02.980440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1290/2542] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:21:02.984706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:02.991751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1253/2543] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:02.994856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7aa18-b6eb-4526-985b-b43fdc402e12 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.000330 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.001003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.001273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.001655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.002566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.002770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.004266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:03.004549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.031305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1291/2544] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:02 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:03.035284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.047544 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:03.063296 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ab4e0-fd49-44de-bdb2-12bf2426b398 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.066740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:03.104260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6d1ee-884d-49dc-b693-5a986fda5839 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.109023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.109696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.109985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.110261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.110948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.112770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.112912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.113417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.113702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.114017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.136784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1292/2545] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:03 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:03.137878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.147991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75894c5c-c633-4609-9284-28b613f64eac admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.152665 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.153321 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.153606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.153888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.154613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.156290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.166335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1293/2546] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:03.170199 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.176556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.177997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.179742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730457b0-a7cb-467d-b8e2-6e930f138f25 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.184389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceac534-262d-4f26-88ca-fa1c61a2f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.184962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac534-262d-4f26-88ca-fa1c61a2f33f admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.185243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac534-262d-4f26-88ca-fa1c61a2f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.185515 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac534-262d-4f26-88ca-fa1c61a2f33f admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.186216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceac534-262d-4f26-88ca-fa1c61a2f33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.187718 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1254/2547] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:03.187854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceac534-262d-4f26-88ca-fa1c61a2f33f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.202128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1294/2548] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:03.204167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.215893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd9b0a-1fbd-44f5-a3cd-316da45040f7 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.221918 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.223018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.223851 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.224135 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] PATH_INFO: `/v3/projects/6635b6cd741f4648a631e494a44bb147/users/4ba71939e43c4cfe8d854d7e1da78b96/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.243438 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6635b6cd741f4648a631e494a44bb147, user_id=4ba71939e43c4cfe8d854d7e1da78b96, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.246461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.260993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1255/2549] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:03 2022] PUT /identity/v3/projects/6635b6cd741f4648a631e494a44bb147/users/4ba71939e43c4cfe8d854d7e1da78b96/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:03.273212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828053a-8f41-4823-b6b3-fe6340fcef09 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.273555 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828053a-8f41-4823-b6b3-fe6340fcef09 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.273759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828053a-8f41-4823-b6b3-fe6340fcef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.302481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6828053a-8f41-4823-b6b3-fe6340fcef09 None None] MFA Rules not processed for user `4ba71939e43c4cfe8d854d7e1da78b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:03.304057 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6828053a-8f41-4823-b6b3-fe6340fcef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:03.383039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1295/2550] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:03.387381 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.470515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29f016-cc6d-4200-8ffa-6524b62e2a90 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.478942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.479740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.480532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.480532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.481044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.483004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.512678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1256/2551] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:03 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:03.516520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828053a-8f41-4823-b6b3-fe6340fcef09 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.529007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828053a-8f41-4823-b6b3-fe6340fcef09 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.600625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.601318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.601608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.601889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.602607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.604654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.627379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1296/2552] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:03 2022] POST /identity/v3/users => generated 302 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:03.631377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.638144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:03.642411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5f4fb-6f2d-4dea-948a-f4719c29674d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.649535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.650204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.650491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.650776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.651503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.653144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.664927 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1257/2553] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:03.668785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.679710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b961f-0b27-4259-98aa-cffd14188879 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.684549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.685509 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.685864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.686220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] PATH_INFO: `/v3/projects/ee3bf4fe923349d4a4bdf8c0229a4363/users/07c9d2227b584a759fb08d667eb5c14f/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.697736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:03.703119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3bf4fe923349d4a4bdf8c0229a4363, user_id=07c9d2227b584a759fb08d667eb5c14f, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.706337 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.723027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1297/2554] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:03 2022] PUT /identity/v3/projects/ee3bf4fe923349d4a4bdf8c0229a4363/users/07c9d2227b584a759fb08d667eb5c14f/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:03.727702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.737853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e33c0b-a3fc-4b3f-8803-59d3c7b52fde admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.773989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.801444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.802160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.802446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.802731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.803454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.805128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.818063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1258/2555] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:03.819383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:03.829082 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb9e0f1-4129-49e4-b573-7a5d4ca254ee admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.831806 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effcefe-aab8-4846-b056-cd62c90f5887 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:03.834330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd411b-2495-4da7-92e5-6236620ee609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.835196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd411b-2495-4da7-92e5-6236620ee609 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.835484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd411b-2495-4da7-92e5-6236620ee609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.835761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd411b-2495-4da7-92e5-6236620ee609 admin admin] PATH_INFO: `/v3/projects/ee3bf4fe923349d4a4bdf8c0229a4363/users/07c9d2227b584a759fb08d667eb5c14f/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.836241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:03.836888 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.837304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.837590 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.837761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd411b-2495-4da7-92e5-6236620ee609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee3bf4fe923349d4a4bdf8c0229a4363, user_id=07c9d2227b584a759fb08d667eb5c14f, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.839465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:03.840446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd411b-2495-4da7-92e5-6236620ee609 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.851070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1259/2556] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:03 2022] PUT /identity/v3/projects/ee3bf4fe923349d4a4bdf8c0229a4363/users/07c9d2227b584a759fb08d667eb5c14f/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:03.861128 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afbef1-82b7-4627-819e-91bfaa77c2b0 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:03.861419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afbef1-82b7-4627-819e-91bfaa77c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:03.861699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afbef1-82b7-4627-819e-91bfaa77c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:03.893617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-89afbef1-82b7-4627-819e-91bfaa77c2b0 None None] MFA Rules not processed for user `07c9d2227b584a759fb08d667eb5c14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:03.895632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-89afbef1-82b7-4627-819e-91bfaa77c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:03.904235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:03.905745 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:03.917389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1298/2557] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:03.976993 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1260/2558] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:04.215981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:04.225237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccb4c3-e4c5-484a-9cf3-96f151f4483a service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:04.279709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:04.280372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:04.280651 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:04.280921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:04.290427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:04.291841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:04.301570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1299/2559] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:04.377774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afbef1-82b7-4627-819e-91bfaa77c2b0 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:04.387457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afbef1-82b7-4627-819e-91bfaa77c2b0 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:04.391054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:04.391696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:04.391978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:04.392285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:04.453048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:04.454487 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:04.459858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:04.465551 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1261/2560] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:06.445975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:06.447493 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:06.500146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:06.524997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca9b0c-d2e1-42c6-a275-c4f51e5aa17c service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:06.530090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716cc2-1020-4605-a389-ce80f0ad15a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:06.530680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716cc2-1020-4605-a389-ce80f0ad15a7 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:06.530964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716cc2-1020-4605-a389-ce80f0ad15a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:06.531241 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716cc2-1020-4605-a389-ce80f0ad15a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:06.533023 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4b716cc2-1020-4605-a389-ce80f0ad15a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:06.545700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716cc2-1020-4605-a389-ce80f0ad15a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:06.547287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716cc2-1020-4605-a389-ce80f0ad15a7 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:06.559510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1300/2561] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:07.892573 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:07.957704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d15bd3-1e1c-49e6-a08a-007695cc34a4 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:07.962306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:07.963172 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:07.963451 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:07.963726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] PATH_INFO: `/v3/users/4ba71939e43c4cfe8d854d7e1da78b96` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:07.964932 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba71939e43c4cfe8d854d7e1da78b96)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:07.966901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:08.012166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba71939e43c4cfe8d854d7e1da78b96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.012838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba71939e43c4cfe8d854d7e1da78b96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.013444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba71939e43c4cfe8d854d7e1da78b96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.026996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba71939e43c4cfe8d854d7e1da78b96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.034775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba71939e43c4cfe8d854d7e1da78b96'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.051852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1262/2562] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:07 2022] DELETE /identity/v3/users/4ba71939e43c4cfe8d854d7e1da78b96 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:08.053880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342248-23cb-49cb-b110-c345c8567033 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:08.054322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342248-23cb-49cb-b110-c345c8567033 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:08.054550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95342248-23cb-49cb-b110-c345c8567033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:08.072402 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-95342248-23cb-49cb-b110-c345c8567033 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:08.073511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-95342248-23cb-49cb-b110-c345c8567033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.140031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1301/2563] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:08.155917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:08.157689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.241778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e8625-018a-4168-94dd-7c6157ad6fca admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:08.246431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:08.247176 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:08.247464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:08.247743 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:08.255129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95342248-23cb-49cb-b110-c345c8567033 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:08.256636 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-95342248-23cb-49cb-b110-c345c8567033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.258380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:08.259837 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:08.272116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95342248-23cb-49cb-b110-c345c8567033 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:08.279118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1263/2564] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:08.282814 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:08.283703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:08.284031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:08.284528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] PATH_INFO: `/v3/users/85a86f52da0144cba33609ac05b9f95d` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:08.285846 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a86f52da0144cba33609ac05b9f95d)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:08.288698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:08.374750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a86f52da0144cba33609ac05b9f95d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.376323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a86f52da0144cba33609ac05b9f95d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.378227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a86f52da0144cba33609ac05b9f95d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.409355 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a86f52da0144cba33609ac05b9f95d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.418609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:08.420888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.421604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-8908eeda-6403-4453-8903-2720c75a0e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a86f52da0144cba33609ac05b9f95d'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.462890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1302/2565] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:08 2022] DELETE /identity/v3/users/85a86f52da0144cba33609ac05b9f95d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:08.467614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:08.468635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:08.469105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:08.469392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:08.494927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:08.496710 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.513242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890ba6c-da29-4817-90a5-855b5b18d1f5 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:08.552006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:08.605770 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:08.608042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1303/2566] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:08.608408 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:08.608613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:08.609711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:08.612409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.619753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:08.622071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.683888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:08.685357 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:08.689032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4dd7b4-7761-4754-9f47-786aed54a8df None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:08.694957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1264/2567] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:08.695583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:08.696655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:08.697512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:08.699773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:08.710179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:08.711755 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:08.724634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1304/2568] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:08.731206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:08.733461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:08.749693 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3460c4-3c9c-43b2-b969-24be4be9326d service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:08.754852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:08.756058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:08.756456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:08.756977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] PATH_INFO: `/v3/projects/6635b6cd741f4648a631e494a44bb147` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:08.758589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6635b6cd741f4648a631e494a44bb147)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:08.760957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:08.851733 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6635b6cd741f4648a631e494a44bb147', 'request_id': 'req-a8968bb5-68da-4551-a348-bd668644ff77'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.860115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6635b6cd741f4648a631e494a44bb147', 'request_id': 'req-a8968bb5-68da-4551-a348-bd668644ff77'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.878818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6635b6cd741f4648a631e494a44bb147', 'request_id': 'req-a8968bb5-68da-4551-a348-bd668644ff77'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.911768 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] The token cache is being invalidate because project 6635b6cd741f4648a631e494a44bb147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:08.913089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.915654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:08.918719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1265/2569] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:08 2022] DELETE /identity/v3/projects/6635b6cd741f4648a631e494a44bb147 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:08.925013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:08.955530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789e0222-9bc0-4ca3-925b-c53250fdc064 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:09.033528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:09.035352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.035760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.036481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] PATH_INFO: `/v3/users/07c9d2227b584a759fb08d667eb5c14f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.038033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c9d2227b584a759fb08d667eb5c14f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:09.041288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:09.102058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:09.103983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:09.117182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c9d2227b584a759fb08d667eb5c14f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.118696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c9d2227b584a759fb08d667eb5c14f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.119638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c9d2227b584a759fb08d667eb5c14f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.127593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8968bb5-68da-4551-a348-bd668644ff77 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:09.134120 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:09.134996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.135358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.135535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] PATH_INFO: `/v3/projects/9fc7566108934a77b0de0ea995e4fa66` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.136769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc7566108934a77b0de0ea995e4fa66)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:09.137342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c9d2227b584a759fb08d667eb5c14f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.138775 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:09.147849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c9d2227b584a759fb08d667eb5c14f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.152991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:09.167206 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1305/2570] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:08 2022] DELETE /identity/v3/users/07c9d2227b584a759fb08d667eb5c14f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:09.232945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc7566108934a77b0de0ea995e4fa66', 'request_id': 'req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.244676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc7566108934a77b0de0ea995e4fa66', 'request_id': 'req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.257014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc7566108934a77b0de0ea995e4fa66', 'request_id': 'req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.279688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] The token cache is being invalidate because project 9fc7566108934a77b0de0ea995e4fa66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:09.280020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.280662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.282473 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1266/2571] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:09 2022] DELETE /identity/v3/projects/9fc7566108934a77b0de0ea995e4fa66 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:09.286827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:09.288379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:09.308973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:09.408110 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e2a187-47ba-497e-bfae-34373391ccd3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:09.524875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:09.531226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.531226 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.531628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] PATH_INFO: `/v3/users/e705ed65d01f4d9ebdb57fbe2e8452fe` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.534031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e705ed65d01f4d9ebdb57fbe2e8452fe)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:09.535264 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:09.559915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:09.561480 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:09.583226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90b920-6ec0-4cb3-82c2-ac0bff6c7d26 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:09.594687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:09.595952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.596350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.596757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] PATH_INFO: `/v3/projects/ee3bf4fe923349d4a4bdf8c0229a4363` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.603616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee3bf4fe923349d4a4bdf8c0229a4363)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:09.608066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:09.632414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e705ed65d01f4d9ebdb57fbe2e8452fe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.633136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e705ed65d01f4d9ebdb57fbe2e8452fe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.633831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e705ed65d01f4d9ebdb57fbe2e8452fe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.663472 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e705ed65d01f4d9ebdb57fbe2e8452fe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.682717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f9c026a3-c41b-45d4-a78f-a39320d53628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e705ed65d01f4d9ebdb57fbe2e8452fe'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.706411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee3bf4fe923349d4a4bdf8c0229a4363', 'request_id': 'req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.710156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1306/2572] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:09 2022] DELETE /identity/v3/users/e705ed65d01f4d9ebdb57fbe2e8452fe => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:09.711624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af740e-1317-402a-9eeb-0192c495f5c3 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.712024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af740e-1317-402a-9eeb-0192c495f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.712340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af740e-1317-402a-9eeb-0192c495f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.713968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee3bf4fe923349d4a4bdf8c0229a4363', 'request_id': 'req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.733644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee3bf4fe923349d4a4bdf8c0229a4363', 'request_id': 'req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.750242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] The token cache is being invalidate because project ee3bf4fe923349d4a4bdf8c0229a4363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:09.750242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.753937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb3f61e9-8974-4ce9-be27-ab6a9ad81f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:09.759447 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-79af740e-1317-402a-9eeb-0192c495f5c3 None None] MFA Rules not processed for user `105646575b4748a88700db4117174c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:09.759953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-79af740e-1317-402a-9eeb-0192c495f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:09.760446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1267/2573] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:09 2022] DELETE /identity/v3/projects/ee3bf4fe923349d4a4bdf8c0229a4363 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:09.761963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55644a-7760-4a53-8a35-5f3b36562810 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.762306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55644a-7760-4a53-8a35-5f3b36562810 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.762523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab55644a-7760-4a53-8a35-5f3b36562810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.798609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ab55644a-7760-4a53-8a35-5f3b36562810 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:09.800705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ab55644a-7760-4a53-8a35-5f3b36562810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:09.853538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:09.903380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1307/2574] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:09.903629 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1268/2575] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:09.905947 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792fdf-6025-4723-b2fb-364ed126b313 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.906386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792fdf-6025-4723-b2fb-364ed126b313 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.906773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33792fdf-6025-4723-b2fb-364ed126b313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.949053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-33792fdf-6025-4723-b2fb-364ed126b313 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:09.950608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-33792fdf-6025-4723-b2fb-364ed126b313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:09.963469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1308/2576] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:09.967774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55644a-7760-4a53-8a35-5f3b36562810 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:09.978589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab55644a-7760-4a53-8a35-5f3b36562810 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:09.983664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:09.984500 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:09.984881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:09.985255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:09.986224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:09.986724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:09.988420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.008782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1269/2577] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:21:10.010556 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792fdf-6025-4723-b2fb-364ed126b313 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.022428 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33792fdf-6025-4723-b2fb-364ed126b313 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.038543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.040324 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.040849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.041832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.042881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.043297 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.045618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:10.045988 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.059448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:10.081039 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1309/2578] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:10.085785 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.153826 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490ba0d-f40e-4404-a8e1-7f468d556cc7 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.179413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12f137-a983-42cb-a2b8-3fd256cb21ef admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.183915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.184680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.184906 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.185180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.185866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.187788 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.211163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1310/2579] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:10.212020 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.214682 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:10.228116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679867f6-6816-45ea-9ab1-6b558e3f29d9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.231446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.232156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.232463 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.232735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.234107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.234567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:10.235108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.235463 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.236246 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] PATH_INFO: `/v3/projects/b03781ed3975444ca4cff57d95fe6b9c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.237095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03781ed3975444ca4cff57d95fe6b9c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.239884 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.293905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03781ed3975444ca4cff57d95fe6b9c', 'request_id': 'req-9160d070-208e-4a89-a0f4-75b8a4edf944'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:10.300879 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03781ed3975444ca4cff57d95fe6b9c', 'request_id': 'req-9160d070-208e-4a89-a0f4-75b8a4edf944'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:10.306218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.307928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.311055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03781ed3975444ca4cff57d95fe6b9c', 'request_id': 'req-9160d070-208e-4a89-a0f4-75b8a4edf944'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:10.319433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1270/2580] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:10.320532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.323475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] The token cache is being invalidate because project b03781ed3975444ca4cff57d95fe6b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:10.323763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:10.324452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9160d070-208e-4a89-a0f4-75b8a4edf944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:10.326201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1311/2581] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:10 2022] DELETE /identity/v3/projects/b03781ed3975444ca4cff57d95fe6b9c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:10.330901 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1099c-0242-4027-ae4f-7c78ea25a845 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.331250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4abf5e-9a38-4386-b4f4-7eda819aa88c service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.331382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1099c-0242-4027-ae4f-7c78ea25a845 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.334501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1099c-0242-4027-ae4f-7c78ea25a845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.353987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c4a1099c-0242-4027-ae4f-7c78ea25a845 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:10.355280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c4a1099c-0242-4027-ae4f-7c78ea25a845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:10.380770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:10.409786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.410465 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.410991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.411270 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.412380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.414183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.430243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1271/2582] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:10.432869 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.434364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1312/2583] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:10.438508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:10.443669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c19e-189b-4717-949a-c6d8cfef8584 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.443960 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c19e-189b-4717-949a-c6d8cfef8584 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.445201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767c19e-189b-4717-949a-c6d8cfef8584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.464785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ad92d-1e79-4d8c-a2a5-9883762b1a0a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.466237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-e767c19e-189b-4717-949a-c6d8cfef8584 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:10.467597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e767c19e-189b-4717-949a-c6d8cfef8584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:10.472666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.474101 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.474566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.475007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.476001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.476850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1313/2584] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:10.478286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.481760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c19e-189b-4717-949a-c6d8cfef8584 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.490970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:10.494930 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767c19e-189b-4717-949a-c6d8cfef8584 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.500879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1272/2585] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:10.502382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.506577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.507616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.508703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.509140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.510108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:10.510598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.512494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.516572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf6cf9-6caf-410a-bd95-91b17f0d815c admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.528314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ca3a-e147-47d8-bafb-b1c167e2c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.529429 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ca3a-e147-47d8-bafb-b1c167e2c2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.529956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ca3a-e147-47d8-bafb-b1c167e2c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.531078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ca3a-e147-47d8-bafb-b1c167e2c2cb admin admin] PATH_INFO: `/v3/projects/0b6b6123c0af4027af152912c8f09ad0/users/d38ff4b1249e4bc28240c8a4ca5ffaa5/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.538409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1314/2586] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:21:10.543262 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.550960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ca3a-e147-47d8-bafb-b1c167e2c2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b6b6123c0af4027af152912c8f09ad0, user_id=d38ff4b1249e4bc28240c8a4ca5ffaa5, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.555160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ca3a-e147-47d8-bafb-b1c167e2c2cb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.558399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5680e57-e0b6-4632-9d6f-23ad7175b4b7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.564698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.565532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.565991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.566436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.568913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.571068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.584555 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1273/2587] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:10 2022] PUT /identity/v3/projects/0b6b6123c0af4027af152912c8f09ad0/users/d38ff4b1249e4bc28240c8a4ca5ffaa5/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:10.587591 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c900eb3-d4c8-4ddc-b437-d701d544d2c4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.588531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c900eb3-d4c8-4ddc-b437-d701d544d2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.588531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c900eb3-d4c8-4ddc-b437-d701d544d2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.630749 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1315/2588] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:10.635907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.651160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3c900eb3-d4c8-4ddc-b437-d701d544d2c4 None None] MFA Rules not processed for user `d38ff4b1249e4bc28240c8a4ca5ffaa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:10.652526 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3c900eb3-d4c8-4ddc-b437-d701d544d2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:10.739774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1274/2589] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:10.744673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c900eb3-d4c8-4ddc-b437-d701d544d2c4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.750871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea2b7f-e7aa-4508-a549-b66a3103d2b8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.756991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c900eb3-d4c8-4ddc-b437-d701d544d2c4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.758044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.759066 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.759457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.759867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.760721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.762821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.771448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.772202 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.772491 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.772761 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.773468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.775558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.808252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1316/2590] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:10.809175 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.822073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c305-6d8c-41a7-b7bb-1c52a7ac52f9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.823740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1275/2591] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:10.828824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.897076 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.909746 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.910049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.910342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.911856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.917497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.934727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c000d9-2f72-4db5-88f7-79f79e30367d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.942391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1317/2592] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:10.943153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.945134 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.945911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.946259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.946665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.947759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.950940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:10.976453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348057df-a9ce-40cc-ae88-59b6d440f6ee admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:10.984631 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1276/2593] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:10 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:10.987283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:10.988277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:10.991827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:10.993026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:10.993026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:10.994843 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:10.999915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.008938 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:11.015214 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b2d8d-cea0-48b1-8870-38165a1b42ce admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.017487 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1318/2594] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:11.023085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.028376 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.029078 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.029366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.029649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.030655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.033028 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.047818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1277/2595] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:11.049161 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eb9ac-9186-4a50-9b57-36625a4732d6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.056719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.062257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea8e7a7-1a3f-4303-b291-4f949c2c35e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.064377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e7a7-1a3f-4303-b291-4f949c2c35e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.064666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e7a7-1a3f-4303-b291-4f949c2c35e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.064943 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea8e7a7-1a3f-4303-b291-4f949c2c35e9 admin admin] PATH_INFO: `/v3/projects/72fdaae48f8641c48cfe5b4482239c7a/users/501013ce938d4a53a1d5c6f931607d76/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.072642 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cc09e-4191-4eff-bd56-41ff701c8dda admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.081404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.083210 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.084009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.084452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] PATH_INFO: `/v3/projects/b64965bfd64b4b6bb6ebce8a227cacf3/users/c1a20ab4a8a64f96bc11a85bb13dada2/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.099239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8e7a7-1a3f-4303-b291-4f949c2c35e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fdaae48f8641c48cfe5b4482239c7a, user_id=501013ce938d4a53a1d5c6f931607d76, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.102975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea8e7a7-1a3f-4303-b291-4f949c2c35e9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.113708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64965bfd64b4b6bb6ebce8a227cacf3, user_id=c1a20ab4a8a64f96bc11a85bb13dada2, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.118878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.131457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1319/2596] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:11 2022] PUT /identity/v3/projects/72fdaae48f8641c48cfe5b4482239c7a/users/501013ce938d4a53a1d5c6f931607d76/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:11.140673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:11.142138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de88a8-4102-4074-8603-b3fe7a8d67ab None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.142436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de88a8-4102-4074-8603-b3fe7a8d67ab None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.142718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de88a8-4102-4074-8603-b3fe7a8d67ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.143699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1278/2597] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:11 2022] PUT /identity/v3/projects/b64965bfd64b4b6bb6ebce8a227cacf3/users/c1a20ab4a8a64f96bc11a85bb13dada2/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:11.148472 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.179034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-c0de88a8-4102-4074-8603-b3fe7a8d67ab None None] MFA Rules not processed for user `501013ce938d4a53a1d5c6f931607d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:11.180499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c0de88a8-4102-4074-8603-b3fe7a8d67ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.246619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9ad77-c54b-433f-a93e-3a26a3e05b17 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.252305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.253083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.253352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.253637 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.254694 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.256870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.269550 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1279/2598] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:11.276362 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.295223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3adb6ed-9269-4d2c-9c83-e67790b2f313 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.301135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1320/2599] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:11.303137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de88a8-4102-4074-8603-b3fe7a8d67ab None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.307093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce31ab1-6b17-448e-adbd-dbd7a41d729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.308359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31ab1-6b17-448e-adbd-dbd7a41d729d admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.308841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31ab1-6b17-448e-adbd-dbd7a41d729d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.309337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce31ab1-6b17-448e-adbd-dbd7a41d729d admin admin] PATH_INFO: `/v3/projects/b64965bfd64b4b6bb6ebce8a227cacf3/users/c1a20ab4a8a64f96bc11a85bb13dada2/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.313815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31ab1-6b17-448e-adbd-dbd7a41d729d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64965bfd64b4b6bb6ebce8a227cacf3, user_id=c1a20ab4a8a64f96bc11a85bb13dada2, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.318477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce31ab1-6b17-448e-adbd-dbd7a41d729d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.331222 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de88a8-4102-4074-8603-b3fe7a8d67ab None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.335328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1280/2600] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:11 2022] PUT /identity/v3/projects/b64965bfd64b4b6bb6ebce8a227cacf3/users/c1a20ab4a8a64f96bc11a85bb13dada2/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:11.346759 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.347273 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.347753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.383015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] MFA Rules not processed for user `c1a20ab4a8a64f96bc11a85bb13dada2`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:11.389467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.416080 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.417815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.418632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.419032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.419878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.422170 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.470369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1321/2601] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:11 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:11.474942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.557506 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1281/2602] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:11.568106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:11.569938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.572796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.581546 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b191d9d-967d-45e6-8352-07ee33c5e21e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.587533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.588773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.589059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.589260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.591838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.592014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.620350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1322/2603] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:11 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:11.622182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.624470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.638827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974ebd9-3cdb-4399-b24a-9ac7f0b00e26 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.645942 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.647130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530e5d6-fa93-45b0-b6d6-083a13b89493 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.647253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.647419 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.647968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] PATH_INFO: `/v3/users/788301e293d24c768104c3bbcfdc907b` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.649295 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=788301e293d24c768104c3bbcfdc907b)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.651317 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.668294 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:11.705293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847a447-8680-46e6-82f0-affdfd827681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.706065 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a447-8680-46e6-82f0-affdfd827681 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.706189 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '788301e293d24c768104c3bbcfdc907b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:11.707076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a447-8680-46e6-82f0-affdfd827681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.707076 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847a447-8680-46e6-82f0-affdfd827681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.707288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '788301e293d24c768104c3bbcfdc907b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:11.707838 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '788301e293d24c768104c3bbcfdc907b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:11.709404 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8847a447-8680-46e6-82f0-affdfd827681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.721568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '788301e293d24c768104c3bbcfdc907b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:11.730210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '788301e293d24c768104c3bbcfdc907b'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:11.753881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1323/2604] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:11 2022] DELETE /identity/v3/users/788301e293d24c768104c3bbcfdc907b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:11.754989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.756366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.794309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a447-8680-46e6-82f0-affdfd827681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.795996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847a447-8680-46e6-82f0-affdfd827681 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.807350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1282/2605] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:11.808898 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.809262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.809672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.832160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:11.834818 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.931781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda85199-f75d-4542-a8fd-86b78c14c7eb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:11.940571 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:11.942513 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:11.943387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:11.944139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:11.949051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1283/2606] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:11.953394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:11.953394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:11.965105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:11.966737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:11.987747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1324/2607] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:11.994038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.008565 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df7a4-ad20-44bc-aca7-e991934b2cab admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.014282 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.015237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.015711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.017154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] PATH_INFO: `/v3/projects/b4ff2959c1cd4009bba006a72ac3de33/users/f0acd27e1f904643a58696b773ff606d/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.033276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ff2959c1cd4009bba006a72ac3de33, user_id=f0acd27e1f904643a58696b773ff606d, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.036936 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.053529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1325/2608] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:11 2022] PUT /identity/v3/projects/b4ff2959c1cd4009bba006a72ac3de33/users/f0acd27e1f904643a58696b773ff606d/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:12.056728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.056728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:12.067410 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d82590-7083-401f-b5c8-9f65d189866a None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.091717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:12.099105 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:12.125798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.126630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.127107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.127254 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.141208 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48fda4-4c28-4a96-9bdb-c5de795782a3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.147185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.149124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.149518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.149810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.152736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:12.197259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.199584 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.209691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1284/2609] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:12.217641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.234251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.235539 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.237516 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b15206-4837-4188-8f6d-31a4508ea480 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.242763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6363048-1c34-46ff-8c40-dfc854e23b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.243431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6363048-1c34-46ff-8c40-dfc854e23b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.243712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6363048-1c34-46ff-8c40-dfc854e23b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.244112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6363048-1c34-46ff-8c40-dfc854e23b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.244945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6363048-1c34-46ff-8c40-dfc854e23b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.246807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6363048-1c34-46ff-8c40-dfc854e23b33 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.248127 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1326/2610] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:12.262308 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1285/2611] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:12.263699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.282547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f924dc-637b-427a-b802-e5606ada49c8 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.290608 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.292369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.292783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.293158 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] PATH_INFO: `/v3/projects/b4ff2959c1cd4009bba006a72ac3de33/users/f0acd27e1f904643a58696b773ff606d/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.296440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ff2959c1cd4009bba006a72ac3de33, user_id=f0acd27e1f904643a58696b773ff606d, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.301022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.327019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1327/2612] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:12 2022] PUT /identity/v3/projects/b4ff2959c1cd4009bba006a72ac3de33/users/f0acd27e1f904643a58696b773ff606d/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:12.329822 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.330216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.330608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.370567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] MFA Rules not processed for user `f0acd27e1f904643a58696b773ff606d`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:12.372567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:12.533224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1286/2613] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:12.547810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.549724 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:12.659387 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.662011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:12.691698 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efb617-dc83-47c3-90f7-d3a524ac39f9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.700672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.701366 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.701695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.701985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.716861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.718769 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.737179 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1328/2614] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:12.852386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.857598 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:12.868081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c01faf9-4d7c-422d-9c96-2e43223b803d service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.871236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f165cc-1000-4ea7-b7fb-1495d5812699 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:12.873645 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.875259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.875537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.875821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.876738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:12.877602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:12.877883 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:12.878156 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] PATH_INFO: `/v3/projects/9306fa49b1fd4a29b7ded95dd4a202a7` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:12.880194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:12.880295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9306fa49b1fd4a29b7ded95dd4a202a7)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.882274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.940859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9306fa49b1fd4a29b7ded95dd4a202a7', 'request_id': 'req-c5eca04f-029e-4ee3-9920-a851a9aff63a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:12.949762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9306fa49b1fd4a29b7ded95dd4a202a7', 'request_id': 'req-c5eca04f-029e-4ee3-9920-a851a9aff63a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:12.962528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9306fa49b1fd4a29b7ded95dd4a202a7', 'request_id': 'req-c5eca04f-029e-4ee3-9920-a851a9aff63a'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:12.975130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:12.976734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] The token cache is being invalidate because project 9306fa49b1fd4a29b7ded95dd4a202a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:12.977779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:12.977900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:12.979000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:12.983601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1287/2615] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:12 2022] DELETE /identity/v3/projects/9306fa49b1fd4a29b7ded95dd4a202a7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:12.984774 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:12.987175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:12.993368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1329/2616] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:13.065111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eca04f-029e-4ee3-9920-a851a9aff63a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:13.070541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:13.071545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:13.071944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:13.072247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] PATH_INFO: `/v3/users/d3ce23d32ed9432ba41583bb522cbab0` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:13.073832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ce23d32ed9432ba41583bb522cbab0)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:13.076053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:13.144328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ce23d32ed9432ba41583bb522cbab0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.146663 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ce23d32ed9432ba41583bb522cbab0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.147375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ce23d32ed9432ba41583bb522cbab0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.165621 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ce23d32ed9432ba41583bb522cbab0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.174098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ce23d32ed9432ba41583bb522cbab0'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.196256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1288/2617] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:12 2022] DELETE /identity/v3/users/d3ce23d32ed9432ba41583bb522cbab0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:13.531965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:13.549436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565418-aac6-4dea-a191-e2d452f19f85 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:13.554866 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:13.623598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:13.624616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:13.624993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:13.625277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] PATH_INFO: `/v3/projects/d51603b34c0f45fabd01976ba3b83ace` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:13.626474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51603b34c0f45fabd01976ba3b83ace)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:13.628433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:13.678818 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51603b34c0f45fabd01976ba3b83ace', 'request_id': 'req-eab137ef-cc54-438e-8d11-955c637e65e0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.685120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51603b34c0f45fabd01976ba3b83ace', 'request_id': 'req-eab137ef-cc54-438e-8d11-955c637e65e0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.693849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51603b34c0f45fabd01976ba3b83ace', 'request_id': 'req-eab137ef-cc54-438e-8d11-955c637e65e0'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.704732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] The token cache is being invalidate because project d51603b34c0f45fabd01976ba3b83ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:13.705017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.705654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.707207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1330/2618] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:13 2022] DELETE /identity/v3/projects/d51603b34c0f45fabd01976ba3b83ace => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:13.711916 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:13.713676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:13.722116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:13.728902 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fedeb0-a3b1-4dd5-a564-5d60b957db98 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:13.819443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:13.820755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:13.821218 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:13.821938 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] PATH_INFO: `/v3/users/8f23b9d7de134b599abefb085bb3abc9` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:13.823790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f23b9d7de134b599abefb085bb3abc9)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:13.826121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:13.909018 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f23b9d7de134b599abefb085bb3abc9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.909797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f23b9d7de134b599abefb085bb3abc9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.910524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f23b9d7de134b599abefb085bb3abc9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.933920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f23b9d7de134b599abefb085bb3abc9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.948687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-fb760e17-1108-4187-a0d2-32c588bac337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f23b9d7de134b599abefb085bb3abc9'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:13.993776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1289/2619] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:13 2022] DELETE /identity/v3/users/8f23b9d7de134b599abefb085bb3abc9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:14.383986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:14.385124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:14.401607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab137ef-cc54-438e-8d11-955c637e65e0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:14.503342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:14.505770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:14.508496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:14.508496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] PATH_INFO: `/v3/projects/2567d1ba237240adb803c46e4f514006` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:14.509931 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2567d1ba237240adb803c46e4f514006)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:14.512560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:14.604748 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:14.616297 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2567d1ba237240adb803c46e4f514006', 'request_id': 'req-7de8416f-24a3-41ad-986e-71370c031f67'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:14.626713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2567d1ba237240adb803c46e4f514006', 'request_id': 'req-7de8416f-24a3-41ad-986e-71370c031f67'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:14.636613 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2567d1ba237240adb803c46e4f514006', 'request_id': 'req-7de8416f-24a3-41ad-986e-71370c031f67'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:14.664207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] The token cache is being invalidate because project 2567d1ba237240adb803c46e4f514006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:14.665209 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:14.667141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-7de8416f-24a3-41ad-986e-71370c031f67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:14.669717 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1331/2620] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:14 2022] DELETE /identity/v3/projects/2567d1ba237240adb803c46e4f514006 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:14.677146 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5319f8-daa8-4eb9-908e-9f908b9170d6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:14.678092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5319f8-daa8-4eb9-908e-9f908b9170d6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:14.678531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5319f8-daa8-4eb9-908e-9f908b9170d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:14.701173 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-0d5319f8-daa8-4eb9-908e-9f908b9170d6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:14.702650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-0d5319f8-daa8-4eb9-908e-9f908b9170d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:14.788226 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1290/2621] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:14.796053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a2cab-48a8-45c5-af53-fbc95d1ffca5 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:14.796053 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a2cab-48a8-45c5-af53-fbc95d1ffca5 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:14.796391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a2cab-48a8-45c5-af53-fbc95d1ffca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:14.824986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8e4a2cab-48a8-45c5-af53-fbc95d1ffca5 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:14.827694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8e4a2cab-48a8-45c5-af53-fbc95d1ffca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:14.858832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1332/2622] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:14.859888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5319f8-daa8-4eb9-908e-9f908b9170d6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:14.872471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5319f8-daa8-4eb9-908e-9f908b9170d6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:14.878730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:14.879512 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:14.880000 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:14.880265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:14.881004 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:14.881304 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:14.883662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:14.902160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1291/2623] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:21:14.907101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a2cab-48a8-45c5-af53-fbc95d1ffca5 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:14.918878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a2cab-48a8-45c5-af53-fbc95d1ffca5 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:14.929815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:14.930882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:14.931174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:14.931946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:14.934310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:14.936992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:14.973244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1333/2624] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:14 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:14.985025 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.009420 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f0f5-dbab-4891-bf53-141db5b12fa2 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.022143 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:15.113315 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.114051 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.114340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.114620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.115332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.119682 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.150906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1292/2625] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:14 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:15.152479 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.163914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f321570-b6b8-4ca5-9329-a1780dd5d42d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.168855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.169632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.170044 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.170423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.171263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.173718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.203688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1334/2626] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:15.208383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.213997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.218096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:15.226582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9308b8-7d97-4bec-9dcd-c51650cf5bd6 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.235424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5953b9-db4c-4b64-9310-ca545dfdc99d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.235984 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.236890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.237276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.237657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.238756 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.241812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.243059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.243195 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.243298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.243298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] PATH_INFO: `/v3/users/d38ff4b1249e4bc28240c8a4ca5ffaa5` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.244687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38ff4b1249e4bc28240c8a4ca5ffaa5)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.247049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.258618 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1293/2627] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:15.263986 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.276599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fafec5-3cbc-4b11-abb7-47091cc3b014 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.283132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308e086-2bf8-407f-8b2d-e4d8e2b8623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.284513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e086-2bf8-407f-8b2d-e4d8e2b8623a admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.284798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e086-2bf8-407f-8b2d-e4d8e2b8623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.285079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308e086-2bf8-407f-8b2d-e4d8e2b8623a admin admin] PATH_INFO: `/v3/projects/08d35289b2784ef79ea84623cec0e95c/users/421062e8f0c343cfa21d0945b8da19af/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.303384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38ff4b1249e4bc28240c8a4ca5ffaa5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:15.304721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38ff4b1249e4bc28240c8a4ca5ffaa5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:15.307564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308e086-2bf8-407f-8b2d-e4d8e2b8623a admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d35289b2784ef79ea84623cec0e95c, user_id=421062e8f0c343cfa21d0945b8da19af, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.309280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38ff4b1249e4bc28240c8a4ca5ffaa5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:15.310529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308e086-2bf8-407f-8b2d-e4d8e2b8623a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.326741 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38ff4b1249e4bc28240c8a4ca5ffaa5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:15.329648 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1294/2628] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:15 2022] PUT /identity/v3/projects/08d35289b2784ef79ea84623cec0e95c/users/421062e8f0c343cfa21d0945b8da19af/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:15.341695 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c610d612-0017-460f-ba0f-30afa6c0878f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38ff4b1249e4bc28240c8a4ca5ffaa5'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:15.344206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.344608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.345063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.366079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1335/2629] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:15 2022] DELETE /identity/v3/users/d38ff4b1249e4bc28240c8a4ca5ffaa5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:15.370380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.371275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.371275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.381319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] MFA Rules not processed for user `421062e8f0c343cfa21d0945b8da19af`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:15.382702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:15.391872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:15.393343 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:15.452314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:15.456753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1295/2630] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:15.461978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1336/2631] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:15.462277 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.463958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:15.471492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.472858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:15.479617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf5dfe-a366-4060-97bb-b47c98df43ba None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.484725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.485399 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.485681 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.485957 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.486660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.489389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.518888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1296/2632] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:15 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:15.520227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.534757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fdd37-922e-4ff7-9399-4c80a758b401 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.554356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:15.588475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.589383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.589922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.590485 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.592121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a2d1f-e915-40ac-9399-9fc8df6f8439 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.605709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.606319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.606624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.606835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.607293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.607560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.609133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.609509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.621760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1337/2633] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:15.635482 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1297/2634] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:15 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:15.636771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.646921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe6a48-7863-4fbf-be9a-885c131e4305 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.651827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.652720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.653009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.653293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.654086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.655709 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.669375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1338/2635] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:15.670653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.681684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7dbde-ee7f-4045-b165-1ace009ecf74 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.686667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7b6297-6815-4136-afff-de53b67ba880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.687449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b6297-6815-4136-afff-de53b67ba880 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.687792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b6297-6815-4136-afff-de53b67ba880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.688698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7b6297-6815-4136-afff-de53b67ba880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.689301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b6297-6815-4136-afff-de53b67ba880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.690973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7b6297-6815-4136-afff-de53b67ba880 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.701949 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1298/2636] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:15.706381 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.717382 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69016569-1b21-467e-a6e5-f21e0f7da807 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.723338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.724270 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.724554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.724957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] PATH_INFO: `/v3/projects/ddd81d68e24646fc8ffd479c7dab2d92/users/1edaa2dce9b64473bd54480594964bf4/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.741512 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd81d68e24646fc8ffd479c7dab2d92, user_id=1edaa2dce9b64473bd54480594964bf4, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.744259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.759860 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1339/2637] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:15 2022] PUT /identity/v3/projects/ddd81d68e24646fc8ffd479c7dab2d92/users/1edaa2dce9b64473bd54480594964bf4/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:15.771248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa37e-3983-4ca0-8887-a5832c7216c1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.771649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa37e-3983-4ca0-8887-a5832c7216c1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.771929 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4fa37e-3983-4ca0-8887-a5832c7216c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.807594 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9c4fa37e-3983-4ca0-8887-a5832c7216c1 None None] MFA Rules not processed for user `1edaa2dce9b64473bd54480594964bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:15.808888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9c4fa37e-3983-4ca0-8887-a5832c7216c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:15.876842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1299/2638] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:15.881899 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.944991 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30866f4b-adf5-46fb-b17c-7baf84cded98 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.949764 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:15.950430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:15.950713 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:15.950992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:15.951693 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:15.953631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:15.981288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1340/2639] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:15 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:15.985657 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fa37e-3983-4ca0-8887-a5832c7216c1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.997675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:15.997936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4fa37e-3983-4ca0-8887-a5832c7216c1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:15.999612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.013702 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:16.082861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3d27-7e87-46c0-bb56-9ed09009bdf3 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.086243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.087261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.087634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.087915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.088024 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.088656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.088874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.089160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.089444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] PATH_INFO: `/v3/projects/0b6b6123c0af4027af152912c8f09ad0` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.090683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b6b6123c0af4027af152912c8f09ad0)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.090958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.092694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.118340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1300/2640] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:15 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:16.122390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.133734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be933890-031d-4c43-b3d9-a64c2546a798 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.138752 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.139243 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.139524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.139796 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.140546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.142129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.152600 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1301/2641] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:16.157098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.159770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b6b6123c0af4027af152912c8f09ad0', 'request_id': 'req-f725ac88-bf3c-491c-965c-e930e9aedd40'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.166835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b6b6123c0af4027af152912c8f09ad0', 'request_id': 'req-f725ac88-bf3c-491c-965c-e930e9aedd40'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.177227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b6b6123c0af4027af152912c8f09ad0', 'request_id': 'req-f725ac88-bf3c-491c-965c-e930e9aedd40'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.179183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5aa5d0-3443-4e69-9a0e-49550265badb admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.189006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] The token cache is being invalidate because project 0b6b6123c0af4027af152912c8f09ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:16.189301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.189948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.191784 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1341/2642] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:15 2022] DELETE /identity/v3/projects/0b6b6123c0af4027af152912c8f09ad0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:16.193504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:16.196494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.201091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.251481 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.252559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.252905 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.253248 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] PATH_INFO: `/v3/projects/980182b8be27461c9f82169e654f8f75/users/a9cebd9c3e2d437fa7c51d53ca795ad8/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.280439 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980182b8be27461c9f82169e654f8f75, user_id=a9cebd9c3e2d437fa7c51d53ca795ad8, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.284624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.308337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1302/2643] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:16 2022] PUT /identity/v3/projects/980182b8be27461c9f82169e654f8f75/users/a9cebd9c3e2d437fa7c51d53ca795ad8/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:16.308535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725ac88-bf3c-491c-965c-e930e9aedd40 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.309523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.311430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.377041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:16.392614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc29a3-0885-48ce-8f67-eb8c0453ce50 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.401909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.401909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.401909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.401909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.402339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.402990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.403532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.404867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.405245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.405646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] PATH_INFO: `/v3/users/c1a20ab4a8a64f96bc11a85bb13dada2` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.406914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a20ab4a8a64f96bc11a85bb13dada2)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.409160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.414974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1303/2644] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:16.418709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.433963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc6ff0-e749-4b63-9eff-6c3a4322a36d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.439800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05885a33-2681-4f18-80ca-b2f4e9781b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.440920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885a33-2681-4f18-80ca-b2f4e9781b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.441316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885a33-2681-4f18-80ca-b2f4e9781b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.441757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885a33-2681-4f18-80ca-b2f4e9781b07 admin admin] PATH_INFO: `/v3/projects/980182b8be27461c9f82169e654f8f75/users/a9cebd9c3e2d437fa7c51d53ca795ad8/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.444264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05885a33-2681-4f18-80ca-b2f4e9781b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980182b8be27461c9f82169e654f8f75, user_id=a9cebd9c3e2d437fa7c51d53ca795ad8, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.448956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05885a33-2681-4f18-80ca-b2f4e9781b07 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.462854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1304/2645] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:16 2022] PUT /identity/v3/projects/980182b8be27461c9f82169e654f8f75/users/a9cebd9c3e2d437fa7c51d53ca795ad8/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:16.472985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.473347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.473624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.480378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a20ab4a8a64f96bc11a85bb13dada2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.481850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a20ab4a8a64f96bc11a85bb13dada2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.482758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a20ab4a8a64f96bc11a85bb13dada2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.502100 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a20ab4a8a64f96bc11a85bb13dada2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.510622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] MFA Rules not processed for user `a9cebd9c3e2d437fa7c51d53ca795ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:16.511307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a20ab4a8a64f96bc11a85bb13dada2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:16.512689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.536205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1342/2646] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:16 2022] DELETE /identity/v3/users/c1a20ab4a8a64f96bc11a85bb13dada2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:16.625794 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1305/2647] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:16.641528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.643111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.734348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df65f99-2950-48ad-874c-391b77dc21bf admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.741276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.742811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.743759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.744263 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.828127 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.830052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.847947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:16.874525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:16.875972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:16.891967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1343/2648] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:16.946897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:16.948450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.952532 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2899f-9e2f-46f3-b744-f7fcc9296f63 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.961310 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfbd6d-bc93-4955-98ed-3c363500f8e5 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:16.965122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:16.965782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:16.966067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:16.966346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:16.968417 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:16.985548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:17.050331 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.052779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.052779 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.054046 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] PATH_INFO: `/v3/users/501013ce938d4a53a1d5c6f931607d76` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.055811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=501013ce938d4a53a1d5c6f931607d76)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.057212 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.057602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.059402 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.071805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1344/2649] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:17.073340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.074880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.089670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8c163-c1b8-4ca2-b72f-7eb9a15b010f service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.094815 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.095810 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.096155 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.096527 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] PATH_INFO: `/v3/projects/b64965bfd64b4b6bb6ebce8a227cacf3` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.098604 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64965bfd64b4b6bb6ebce8a227cacf3)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.101339 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.147595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501013ce938d4a53a1d5c6f931607d76'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.148564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501013ce938d4a53a1d5c6f931607d76'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.149554 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501013ce938d4a53a1d5c6f931607d76'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.165658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501013ce938d4a53a1d5c6f931607d76'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.174630 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-19981fc3-735d-4bce-8297-4fbace64d7cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501013ce938d4a53a1d5c6f931607d76'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.187763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64965bfd64b4b6bb6ebce8a227cacf3', 'request_id': 'req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.191366 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1306/2650] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:16 2022] DELETE /identity/v3/users/501013ce938d4a53a1d5c6f931607d76 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:17.196194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64965bfd64b4b6bb6ebce8a227cacf3', 'request_id': 'req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.196699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.197644 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.197996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.206959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64965bfd64b4b6bb6ebce8a227cacf3', 'request_id': 'req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.218809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:17.220191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.220816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] The token cache is being invalidate because project b64965bfd64b4b6bb6ebce8a227cacf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:17.221115 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.221841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-455c9173-bdb0-4c0e-a6cd-6f35930ea6d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.223599 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1345/2651] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:17 2022] DELETE /identity/v3/projects/b64965bfd64b4b6bb6ebce8a227cacf3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:17.229844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242b9b-1308-42c8-b351-9f98de0ede70 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.230730 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242b9b-1308-42c8-b351-9f98de0ede70 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.231012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242b9b-1308-42c8-b351-9f98de0ede70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.251902 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-13242b9b-1308-42c8-b351-9f98de0ede70 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:17.253498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-13242b9b-1308-42c8-b351-9f98de0ede70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.257495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:17.296553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1307/2652] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:17.308893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.310646 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.326348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1346/2653] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:17.336436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a7e3-4ca5-4aec-bb4b-7eb8435a229e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.336758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a7e3-4ca5-4aec-bb4b-7eb8435a229e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.337036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a7e3-4ca5-4aec-bb4b-7eb8435a229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.357105 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6c12a7e3-4ca5-4aec-bb4b-7eb8435a229e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:17.358492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6c12a7e3-4ca5-4aec-bb4b-7eb8435a229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.370134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1347/2654] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:17.375579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a7e3-4ca5-4aec-bb4b-7eb8435a229e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.385456 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a7e3-4ca5-4aec-bb4b-7eb8435a229e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.391833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.392673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.393021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.393372 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.394060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763d650-4873-48c1-87e2-8d6146c48715 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.394522 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:17.394877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.396963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.399092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.399881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.400166 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.400474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.410288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1348/2655] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:21:17.412667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.414264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.415422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.429246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1308/2656] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:17.447557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f277578-4847-4bd1-a7fa-b4803bee3d91 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.453658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.454545 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.454840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.455122 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.455882 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.458553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.478306 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:17.500148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1349/2657] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:17 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:17.501208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.511507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdefca0-68a6-4f11-ae94-e1f27744f091 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.576564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.577145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.577430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.577715 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.578423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.580373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.610434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1309/2658] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:17 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:17.615332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.626511 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37e101-8656-499d-a20b-e9666f388e57 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.632280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.633137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.633420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.633805 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.634543 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.636646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.648118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1350/2659] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:17.651914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.663190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa67ff4-1afa-4373-84c2-258bfb62c645 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.668319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.668987 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.669269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.669546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.670274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.671873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.683850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1310/2660] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:17.688019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.698626 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9278b-735d-4b8d-9eee-bb45a1d7b6a9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.703301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f5d31-03ac-493a-853d-c003ff11a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.704252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f5d31-03ac-493a-853d-c003ff11a23c admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.704537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f5d31-03ac-493a-853d-c003ff11a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.704812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f5d31-03ac-493a-853d-c003ff11a23c admin admin] PATH_INFO: `/v3/projects/68b317eceae548bea95b3e248730f709/users/607fc3a0a3404958bb2d700d713f688c/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.720284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f5d31-03ac-493a-853d-c003ff11a23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b317eceae548bea95b3e248730f709, user_id=607fc3a0a3404958bb2d700d713f688c, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.722989 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f5d31-03ac-493a-853d-c003ff11a23c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.736955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1351/2661] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:17 2022] PUT /identity/v3/projects/68b317eceae548bea95b3e248730f709/users/607fc3a0a3404958bb2d700d713f688c/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:17.738533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.748853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.749108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.749486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.752894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.772250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3015774-ec2a-46ed-9975-5be827eb69aa admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.785791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] MFA Rules not processed for user `607fc3a0a3404958bb2d700d713f688c`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:17.787008 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.825627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:17.833323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.834191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.834475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.834757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] PATH_INFO: `/v3/projects/72fdaae48f8641c48cfe5b4482239c7a` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.835954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72fdaae48f8641c48cfe5b4482239c7a)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:17.837909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:17.854614 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1352/2662] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:17.866469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.867935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.891560 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72fdaae48f8641c48cfe5b4482239c7a', 'request_id': 'req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.898807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72fdaae48f8641c48cfe5b4482239c7a', 'request_id': 'req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.906147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72fdaae48f8641c48cfe5b4482239c7a', 'request_id': 'req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.917737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] The token cache is being invalidate because project 72fdaae48f8641c48cfe5b4482239c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:17.918104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.918753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:17.920383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1311/2663] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:17 2022] DELETE /identity/v3/projects/72fdaae48f8641c48cfe5b4482239c7a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:17.924111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:17.925474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.928401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed9276-19d6-4b17-8a42-077a13026570 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.977897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd5a266491c487385349368b5ccbbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.978548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.978828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.979104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.980933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:17.992203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ed757-e9cf-4750-88cf-c8e52fd0ac14 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:17.997204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:17.998064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:17.998375 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:17.998648 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] PATH_INFO: `/v3/users/f0acd27e1f904643a58696b773ff606d` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:17.999852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0acd27e1f904643a58696b773ff606d)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:18.001211 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:18.001807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:18.042425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:18.043862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:18.049669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0acd27e1f904643a58696b773ff606d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.050325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0acd27e1f904643a58696b773ff606d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.050964 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0acd27e1f904643a58696b773ff606d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.054279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1353/2664] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:18.065937 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0acd27e1f904643a58696b773ff606d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.075287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d619a0b0-2358-44a1-919c-1c9be0e92f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0acd27e1f904643a58696b773ff606d'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.089339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1312/2665] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:17 2022] DELETE /identity/v3/users/f0acd27e1f904643a58696b773ff606d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:18.469346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:18.484975 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1399ee-b716-4bb9-ad7e-0c32e779d712 service glance] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:18.568685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:18.569583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:18.569854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:18.570146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] PATH_INFO: `/v3/projects/b4ff2959c1cd4009bba006a72ac3de33` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:18.571425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ff2959c1cd4009bba006a72ac3de33)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:18.573499 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:18.639871 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ff2959c1cd4009bba006a72ac3de33', 'request_id': 'req-ab91bf58-0bfb-4587-bdee-6293ee1668f2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.647082 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ff2959c1cd4009bba006a72ac3de33', 'request_id': 'req-ab91bf58-0bfb-4587-bdee-6293ee1668f2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.656620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ff2959c1cd4009bba006a72ac3de33', 'request_id': 'req-ab91bf58-0bfb-4587-bdee-6293ee1668f2'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.670249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] The token cache is being invalidate because project b4ff2959c1cd4009bba006a72ac3de33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:18.670588 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.671267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ab91bf58-0bfb-4587-bdee-6293ee1668f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:18.677986 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1354/2666] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:18 2022] DELETE /identity/v3/projects/b4ff2959c1cd4009bba006a72ac3de33 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:18.678985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ceb0c-e11e-43bd-af6e-e62e2da066cd None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:18.679344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ceb0c-e11e-43bd-af6e-e62e2da066cd None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:18.679717 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ceb0c-e11e-43bd-af6e-e62e2da066cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:18.713118 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:18.722619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-be1ceb0c-e11e-43bd-af6e-e62e2da066cd None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:18.724599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-be1ceb0c-e11e-43bd-af6e-e62e2da066cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:18.800390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1313/2667] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:18.809972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06e437-b2c1-42c9-8161-522adf1f9d54 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:18.810345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06e437-b2c1-42c9-8161-522adf1f9d54 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:18.810699 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06e437-b2c1-42c9-8161-522adf1f9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:18.841448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-2f06e437-b2c1-42c9-8161-522adf1f9d54 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:18.844235 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2f06e437-b2c1-42c9-8161-522adf1f9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:18.859203 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1355/2668] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:18.861257 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ceb0c-e11e-43bd-af6e-e62e2da066cd None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:18.875534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ceb0c-e11e-43bd-af6e-e62e2da066cd None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:18.884287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:18.884968 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:18.885358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:18.885608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:18.886683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:18.887256 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:18.889059 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:18.906326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1314/2669] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:21:18.907383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06e437-b2c1-42c9-8161-522adf1f9d54 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:18.928842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06e437-b2c1-42c9-8161-522adf1f9d54 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:18.937577 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:18.938348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:18.939035 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:18.939338 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:18.940437 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:18.942804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:18.980205 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1356/2670] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:18 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:18.984367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:18.995627 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8187ec2-aa89-48b5-b2f0-c02962c973c0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:19.060231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:19.060934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.061178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.061452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.062208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:19.064122 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:19.086665 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1315/2671] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:18 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:19.090867 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:19.101104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502300c-e89b-4ab2-8f00-4f48bd7e6d49 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:19.105716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:19.106367 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.106649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.106923 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.107642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:19.109257 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:19.120085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1357/2672] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:19.124707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:19.138353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf60a4-377a-4d0e-864c-63aac4cf2fbe admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:19.143264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d507e-207b-47b4-af83-5078a2ec7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:19.143906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d507e-207b-47b4-af83-5078a2ec7005 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.144216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d507e-207b-47b4-af83-5078a2ec7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.144497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d507e-207b-47b4-af83-5078a2ec7005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.145885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d507e-207b-47b4-af83-5078a2ec7005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:19.147503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d507e-207b-47b4-af83-5078a2ec7005 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:19.158053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1316/2673] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:19.162649 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:19.173101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9cd5b-71f6-4f2c-b555-fd8dc1159bb9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:19.177968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:19.178868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.179151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.179448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] PATH_INFO: `/v3/projects/e6cb4fafbce54ee99ebddc65539a6e7e/users/5b8673f81de246df886ed2ee0cd734ed/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.187621 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:19.198290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6cb4fafbce54ee99ebddc65539a6e7e, user_id=5b8673f81de246df886ed2ee0cd734ed, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:19.202684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:19.218432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1358/2674] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:19 2022] PUT /identity/v3/projects/e6cb4fafbce54ee99ebddc65539a6e7e/users/5b8673f81de246df886ed2ee0cd734ed/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:19.229736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f85c-1f96-4be2-a136-af58fa9423bc None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.230096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f85c-1f96-4be2-a136-af58fa9423bc None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.230356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09f85c-1f96-4be2-a136-af58fa9423bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.264525 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9a09f85c-1f96-4be2-a136-af58fa9423bc None None] MFA Rules not processed for user `5b8673f81de246df886ed2ee0cd734ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:19.265914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9a09f85c-1f96-4be2-a136-af58fa9423bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:19.345023 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1317/2675] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:19.364377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:19.366163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:19.434249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4e00b-390b-43c9-b465-0f5a2d9376a1 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:19.438465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a74130-6bc8-49a9-8a94-a4b202f21715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:19.439239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a74130-6bc8-49a9-8a94-a4b202f21715 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.439660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a74130-6bc8-49a9-8a94-a4b202f21715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.439952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a74130-6bc8-49a9-8a94-a4b202f21715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.454261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a74130-6bc8-49a9-8a94-a4b202f21715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:19.455714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a74130-6bc8-49a9-8a94-a4b202f21715 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:19.464934 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1359/2676] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:19.486041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09f85c-1f96-4be2-a136-af58fa9423bc None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:19.490991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:19.553782 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09f85c-1f96-4be2-a136-af58fa9423bc None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:19.558610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:19.561963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.562246 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.562533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] PATH_INFO: `/v3/users/5b8673f81de246df886ed2ee0cd734ed` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.563839 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8673f81de246df886ed2ee0cd734ed)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:19.565806 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:19.619814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8673f81de246df886ed2ee0cd734ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:19.620640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8673f81de246df886ed2ee0cd734ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:19.621380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8673f81de246df886ed2ee0cd734ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:19.633732 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8673f81de246df886ed2ee0cd734ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:19.640801 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8673f81de246df886ed2ee0cd734ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:19.653459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1318/2677] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:19 2022] DELETE /identity/v3/users/5b8673f81de246df886ed2ee0cd734ed => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:19.658000 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.658497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.658600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.675958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:19.678331 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:19.738534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1360/2678] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:19.748922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:19.750325 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:19.808990 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c57cb-0c13-44b3-8967-d602d6a77604 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:19.812687 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:19.813335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:19.813620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:19.813897 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:19.823149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:19.824662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:19.834854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1319/2679] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:20.133703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.135252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.136337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.137771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.148399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5a57f-bace-4cfa-bd72-dd3a1a3ced36 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.151763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79784883-9e89-4559-b10f-4b4046a8bfdf service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.153436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.154462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.154735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.155129 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] PATH_INFO: `/v3/projects/e6cb4fafbce54ee99ebddc65539a6e7e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.157153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6cb4fafbce54ee99ebddc65539a6e7e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.157647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.158535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.158815 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.159094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] PATH_INFO: `/v3/users/421062e8f0c343cfa21d0945b8da19af` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.160201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.160383 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421062e8f0c343cfa21d0945b8da19af)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.162649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.188075 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:20.218141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6cb4fafbce54ee99ebddc65539a6e7e', 'request_id': 'req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.219007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421062e8f0c343cfa21d0945b8da19af'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.220919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421062e8f0c343cfa21d0945b8da19af'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.221508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421062e8f0c343cfa21d0945b8da19af'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.225336 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6cb4fafbce54ee99ebddc65539a6e7e', 'request_id': 'req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.235669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6cb4fafbce54ee99ebddc65539a6e7e', 'request_id': 'req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.240149 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421062e8f0c343cfa21d0945b8da19af'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.247795 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] The token cache is being invalidate because project e6cb4fafbce54ee99ebddc65539a6e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:20.248141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.248475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-ca15a868-ae4c-4a50-bd7a-bfcf4c1b1251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421062e8f0c343cfa21d0945b8da19af'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.248913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-1c187aa1-2fef-4963-ba78-e0d23e3cab2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:20.250718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1361/2680] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:20 2022] DELETE /identity/v3/projects/e6cb4fafbce54ee99ebddc65539a6e7e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:20.256268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d0d9a-8f37-404a-8f2c-5f9a1284235e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.256634 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d0d9a-8f37-404a-8f2c-5f9a1284235e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.257078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d0d9a-8f37-404a-8f2c-5f9a1284235e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.265350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1320/2681] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:20 2022] DELETE /identity/v3/users/421062e8f0c343cfa21d0945b8da19af => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:20.272010 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.272704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.273295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.281414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-4e0d0d9a-8f37-404a-8f2c-5f9a1284235e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:20.282632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4e0d0d9a-8f37-404a-8f2c-5f9a1284235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.291639 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:20.293229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:20.294716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.354088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1362/2682] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:20.361329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1321/2683] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:20.362970 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853ce2-1db0-45d8-9dca-ccfb8bfd000b None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.363269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853ce2-1db0-45d8-9dca-ccfb8bfd000b None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.363551 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853ce2-1db0-45d8-9dca-ccfb8bfd000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.371824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.373237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.384720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d5853ce2-1db0-45d8-9dca-ccfb8bfd000b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:20.385979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d5853ce2-1db0-45d8-9dca-ccfb8bfd000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.394919 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1363/2684] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:20.399059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853ce2-1db0-45d8-9dca-ccfb8bfd000b None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.408514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853ce2-1db0-45d8-9dca-ccfb8bfd000b None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.414113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.414798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.415086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.415364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.416242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:20.416559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.418391 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.433809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1364/2685] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:21:20.438704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.449073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d0e53-b0e2-4e6c-aa45-a39588ed24fa admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.449996 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a782-a37b-480b-8541-a9d9b2e7b14f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.453857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.454528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.454809 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.454917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.455085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.455773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.456128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.456508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.457458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.459620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.466859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.469159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.484041 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1322/2686] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:20.501501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1365/2687] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:20 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:20.505411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.517192 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c395b-ceb9-4fbb-a4f3-39704f5ea787 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.570995 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:20.596854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.597748 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.598106 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.598606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.599448 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.601911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.624802 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1323/2688] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:20 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:20.630248 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.641327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5fcad-02ee-4ff3-b317-d2ced689a015 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.651276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.652128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.652290 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.652707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.653464 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.655146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.667653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1366/2689] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:20.672707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.684434 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661cbb7-c3de-47e1-a94d-7a66c44cb9ec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.689373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240dd310-be88-4607-bd5a-8f8fe49b18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.690045 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd310-be88-4607-bd5a-8f8fe49b18bd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.690632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd310-be88-4607-bd5a-8f8fe49b18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.690632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dd310-be88-4607-bd5a-8f8fe49b18bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.691322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dd310-be88-4607-bd5a-8f8fe49b18bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.693714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240dd310-be88-4607-bd5a-8f8fe49b18bd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.705963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1324/2690] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:20.710055 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.725010 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83793488-073d-4153-84a8-90cd37166326 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:20.738304 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:20.739385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.739886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.740416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] PATH_INFO: `/v3/projects/5c97e7e74d474124be6afd93cdba9eff/users/6e3ce554eeb34e75890c75aefe766d65/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.757640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c97e7e74d474124be6afd93cdba9eff, user_id=6e3ce554eeb34e75890c75aefe766d65, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:20.763243 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:20.781740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1367/2691] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:20 2022] PUT /identity/v3/projects/5c97e7e74d474124be6afd93cdba9eff/users/6e3ce554eeb34e75890c75aefe766d65/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:20.792278 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:20.792700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:20.793073 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:20.825154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] MFA Rules not processed for user `6e3ce554eeb34e75890c75aefe766d65`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:20.826566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.923758 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.926959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:20.947038 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1325/2692] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:20.957539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:20.959529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:21.006425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd9ad-5c5d-4a73-8314-c98227b6af88 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:21.011598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:21.012568 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:21.012870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:21.013164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] PATH_INFO: `/v3/projects/08d35289b2784ef79ea84623cec0e95c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:21.014449 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d35289b2784ef79ea84623cec0e95c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:21.016420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:21.037931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff868d80-c74e-4810-a710-92742bb4b7ff None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:21.042364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4fd5a266491c487385349368b5ccbbc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:21.043402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:21.043402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:21.043651 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:21.054352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:21.055846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:21.067643 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:21.069268 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1326/2693] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:21.082139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d35289b2784ef79ea84623cec0e95c', 'request_id': 'req-4d3e3c70-de78-49cf-83c2-4005c785cf3a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.093397 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d35289b2784ef79ea84623cec0e95c', 'request_id': 'req-4d3e3c70-de78-49cf-83c2-4005c785cf3a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.102423 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d35289b2784ef79ea84623cec0e95c', 'request_id': 'req-4d3e3c70-de78-49cf-83c2-4005c785cf3a'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.114783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] The token cache is being invalidate because project 08d35289b2784ef79ea84623cec0e95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:21.115352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.116287 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.123115 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:21.125729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1368/2694] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:20 2022] DELETE /identity/v3/projects/08d35289b2784ef79ea84623cec0e95c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:21.142632 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112c4667-4367-4de8-aa2f-038d17b910e0 service glance] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:21.205396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:21.218725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:21.219610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:21.219888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:21.220674 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] PATH_INFO: `/v3/users/1edaa2dce9b64473bd54480594964bf4` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:21.221574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1edaa2dce9b64473bd54480594964bf4)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:21.224153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:21.275660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1edaa2dce9b64473bd54480594964bf4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.276190 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1edaa2dce9b64473bd54480594964bf4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.276863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1edaa2dce9b64473bd54480594964bf4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.290955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1edaa2dce9b64473bd54480594964bf4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.298811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1edaa2dce9b64473bd54480594964bf4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.312264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1327/2695] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:21 2022] DELETE /identity/v3/users/1edaa2dce9b64473bd54480594964bf4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:21.617172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:21.618885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:21.634124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e3c70-de78-49cf-83c2-4005c785cf3a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:21.696328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:21.697213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:21.697494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:21.697770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] PATH_INFO: `/v3/projects/ddd81d68e24646fc8ffd479c7dab2d92` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:21.698993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd81d68e24646fc8ffd479c7dab2d92)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:21.700944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:21.752049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd81d68e24646fc8ffd479c7dab2d92', 'request_id': 'req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.759090 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd81d68e24646fc8ffd479c7dab2d92', 'request_id': 'req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.773178 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd81d68e24646fc8ffd479c7dab2d92', 'request_id': 'req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.785193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] The token cache is being invalidate because project ddd81d68e24646fc8ffd479c7dab2d92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:21.785480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.786767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.788612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1369/2696] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:21 2022] DELETE /identity/v3/projects/ddd81d68e24646fc8ffd479c7dab2d92 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:21.792400 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:21.794138 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:21.808680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b1453-488f-460b-8171-3b539c09ff77 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:21.878390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:21.880301 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:21.880724 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:21.881090 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] PATH_INFO: `/v3/users/a9cebd9c3e2d437fa7c51d53ca795ad8` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:21.882810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cebd9c3e2d437fa7c51d53ca795ad8)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:21.888638 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:21.941522 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cebd9c3e2d437fa7c51d53ca795ad8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.943288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cebd9c3e2d437fa7c51d53ca795ad8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.943969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cebd9c3e2d437fa7c51d53ca795ad8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.958242 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cebd9c3e2d437fa7c51d53ca795ad8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.965994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-317a3bf4-93b7-4966-8bec-9846f1e8fcfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cebd9c3e2d437fa7c51d53ca795ad8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:21.967302 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:21.984634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1328/2697] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:21 2022] DELETE /identity/v3/users/a9cebd9c3e2d437fa7c51d53ca795ad8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:22.279953 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:22.281811 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:22.296842 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f36bcc-7c05-499d-9ce8-9b37ba4ad0ca admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:22.352386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:22.358877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:22.360157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.360469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.360992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] PATH_INFO: `/v3/projects/980182b8be27461c9f82169e654f8f75` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.362416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=980182b8be27461c9f82169e654f8f75)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:22.364790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:22.412962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980182b8be27461c9f82169e654f8f75', 'request_id': 'req-680afa74-4ff5-421f-b192-7725035af0ce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:22.418961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980182b8be27461c9f82169e654f8f75', 'request_id': 'req-680afa74-4ff5-421f-b192-7725035af0ce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:22.426703 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980182b8be27461c9f82169e654f8f75', 'request_id': 'req-680afa74-4ff5-421f-b192-7725035af0ce'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:22.437458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] The token cache is being invalidate because project 980182b8be27461c9f82169e654f8f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:22.437747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:22.438410 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-680afa74-4ff5-421f-b192-7725035af0ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:22.439964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1370/2698] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:22 2022] DELETE /identity/v3/projects/980182b8be27461c9f82169e654f8f75 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:22.446064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04910-7141-4cc6-beab-15b62df1a79d None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.446590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04910-7141-4cc6-beab-15b62df1a79d None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.446590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b04910-7141-4cc6-beab-15b62df1a79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.465661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d3b04910-7141-4cc6-beab-15b62df1a79d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:22.466862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d3b04910-7141-4cc6-beab-15b62df1a79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:22.526737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1329/2699] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:22.537664 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6d65-2e9a-4f48-a1f5-d9cb252b8867 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.537933 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6d65-2e9a-4f48-a1f5-d9cb252b8867 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.538216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a6d65-2e9a-4f48-a1f5-d9cb252b8867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.558221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-1a1a6d65-2e9a-4f48-a1f5-d9cb252b8867 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:22.559448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-1a1a6d65-2e9a-4f48-a1f5-d9cb252b8867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:22.568249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1371/2700] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:22.572496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b04910-7141-4cc6-beab-15b62df1a79d None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:22.582668 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b04910-7141-4cc6-beab-15b62df1a79d None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:22.587371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:22.588144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.588324 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.588601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.589328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:22.589635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:22.591264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:22.609002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1330/2701] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:21:22.610187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a6d65-2e9a-4f48-a1f5-d9cb252b8867 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:22.629596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a6d65-2e9a-4f48-a1f5-d9cb252b8867 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:22.634400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:22.635061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.635346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.635624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.636387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:22.638271 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:22.665466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1372/2702] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:22 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:22.669622 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:22.680520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0ece-83eb-48b7-8bba-2478c9325b80 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:22.757673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:22.758479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.758771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.759112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.759825 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:22.764245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:22.787787 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1331/2703] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:22 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:22.789538 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:22.800384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707fb0-4472-45ee-8acf-07d76e21b2d9 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:22.805314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:22.805971 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.806255 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.806533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.807259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:22.808964 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:22.820081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1373/2704] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:22.824092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:22.839700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ca45f-4362-47ce-8231-4c48bffc9140 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:22.844423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03fe66-1f7b-46a8-ac26-5ab96aafa5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:22.845088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03fe66-1f7b-46a8-ac26-5ab96aafa5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.845368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03fe66-1f7b-46a8-ac26-5ab96aafa5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.845641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03fe66-1f7b-46a8-ac26-5ab96aafa5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.846361 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03fe66-1f7b-46a8-ac26-5ab96aafa5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:22.847961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03fe66-1f7b-46a8-ac26-5ab96aafa5ab admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:22.860150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1332/2705] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:22.864322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:22.874821 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ed35e-d055-4ed0-bfd3-216d53878f4e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:22.879427 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:22.881163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.881457 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.881735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] PATH_INFO: `/v3/projects/8d153315164c4c6c9a9b47d0a3f5d684/users/77fde47952f9422fbaa724aeb5b81013/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.897414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d153315164c4c6c9a9b47d0a3f5d684, user_id=77fde47952f9422fbaa724aeb5b81013, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:22.900099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:22.914353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1374/2706] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:22 2022] PUT /identity/v3/projects/8d153315164c4c6c9a9b47d0a3f5d684/users/77fde47952f9422fbaa724aeb5b81013/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:22.926634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae29ae-5d09-4db4-8586-23cf211adbf6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:22.927168 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae29ae-5d09-4db4-8586-23cf211adbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:22.927456 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae29ae-5d09-4db4-8586-23cf211adbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:22.955739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e8ae29ae-5d09-4db4-8586-23cf211adbf6 None None] MFA Rules not processed for user `77fde47952f9422fbaa724aeb5b81013`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:22.959006 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e8ae29ae-5d09-4db4-8586-23cf211adbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:23.005547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:23.030431 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1333/2707] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:23.034153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:23.106967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e28731-5dc0-4016-a715-04b790bc5f53 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:23.111098 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:23.111721 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.112001 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.112309 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.113005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:23.115233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:23.140743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1375/2708] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:23 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:23.144745 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae29ae-5d09-4db4-8586-23cf211adbf6 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:23.155994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae29ae-5d09-4db4-8586-23cf211adbf6 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:23.214580 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:23.215259 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.215546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.215824 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.216556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:23.218515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:23.237974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1334/2709] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:23 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:23.242797 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:23.254278 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e16588d-d147-4280-853c-ceb08d3621eb admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:23.261985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:23.262670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.263075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.263359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.264153 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:23.265850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:23.268606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:23.284514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1376/2710] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:23.285812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:23.296784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bbbf8c-7efd-4f8d-966f-d30fb4cb8ff5 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:23.301567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:23.303250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.303542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.303827 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] PATH_INFO: `/v3/projects/3b63b314590a451fa9607a5ddb7dd186/users/bdb5218fd0a848f29c7900dd5eb19e1e/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.325661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b63b314590a451fa9607a5ddb7dd186, user_id=bdb5218fd0a848f29c7900dd5eb19e1e, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:23.329286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:23.345662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1335/2711] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:23 2022] PUT /identity/v3/projects/3b63b314590a451fa9607a5ddb7dd186/users/bdb5218fd0a848f29c7900dd5eb19e1e/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:23.350130 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:23.360855 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c14a0-3583-4f42-a1cb-21aff221b995 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:23.425516 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead23b5-012d-4fbf-8ed3-7fa15d4836d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:23.426369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead23b5-012d-4fbf-8ed3-7fa15d4836d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.426768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead23b5-012d-4fbf-8ed3-7fa15d4836d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.427107 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead23b5-012d-4fbf-8ed3-7fa15d4836d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.428140 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead23b5-012d-4fbf-8ed3-7fa15d4836d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:23.430075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead23b5-012d-4fbf-8ed3-7fa15d4836d5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:23.440687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1377/2712] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:23.445603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:23.456040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f3546-49d0-42af-a99a-dfbce6f8c62e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:23.461575 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:23.462488 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.462742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.463034 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] PATH_INFO: `/v3/projects/3b63b314590a451fa9607a5ddb7dd186/users/bdb5218fd0a848f29c7900dd5eb19e1e/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.465033 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b63b314590a451fa9607a5ddb7dd186, user_id=bdb5218fd0a848f29c7900dd5eb19e1e, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:23.467879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:23.481634 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1336/2713] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:23 2022] PUT /identity/v3/projects/3b63b314590a451fa9607a5ddb7dd186/users/bdb5218fd0a848f29c7900dd5eb19e1e/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:23.492298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800a36b-013d-4979-884c-1c9211f6fdb9 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.492648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800a36b-013d-4979-884c-1c9211f6fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.493134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800a36b-013d-4979-884c-1c9211f6fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.523099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-f800a36b-013d-4979-884c-1c9211f6fdb9 None None] MFA Rules not processed for user `bdb5218fd0a848f29c7900dd5eb19e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:23.524646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f800a36b-013d-4979-884c-1c9211f6fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:23.608718 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1378/2714] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:23.620406 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:23.622337 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:23.705522 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc032647-4df3-4833-957f-153193fa2866 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:23.713673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d9139-1c03-4b0d-a22a-13af511909ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:23.714336 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d9139-1c03-4b0d-a22a-13af511909ff service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:23.714624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d9139-1c03-4b0d-a22a-13af511909ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:23.714895 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d9139-1c03-4b0d-a22a-13af511909ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:23.726903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d9139-1c03-4b0d-a22a-13af511909ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:23.728567 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d9139-1c03-4b0d-a22a-13af511909ff service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:23.738797 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1337/2715] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:24.148836 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800a36b-013d-4979-884c-1c9211f6fdb9 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:24.226856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800a36b-013d-4979-884c-1c9211f6fdb9 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:24.231345 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:24.232239 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:24.232526 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:24.232832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] PATH_INFO: `/v3/users/77fde47952f9422fbaa724aeb5b81013` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:24.233966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77fde47952f9422fbaa724aeb5b81013)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:24.235898 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:24.258401 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:24.285228 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77fde47952f9422fbaa724aeb5b81013'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.285885 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77fde47952f9422fbaa724aeb5b81013'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.286951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77fde47952f9422fbaa724aeb5b81013'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.298465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77fde47952f9422fbaa724aeb5b81013'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.306133 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77fde47952f9422fbaa724aeb5b81013'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.318858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1379/2716] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:24 2022] DELETE /identity/v3/users/77fde47952f9422fbaa724aeb5b81013 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:24.323545 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:24.323874 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:24.324158 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:24.343944 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:24.345215 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:24.381110 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:24.407515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1338/2717] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:24.417706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:24.419103 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:24.481581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb844dd-563d-4801-a957-dd69ec222b16 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:24.485272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:24.485922 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:24.486221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:24.486476 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:24.496168 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:24.497873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:24.508757 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1380/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:24.788450 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:24.789976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:24.803933 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c9cdc-30fc-4d59-8a2f-fa317f814064 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:24.812247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:24.812247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:24.812247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:24.812247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] PATH_INFO: `/v3/projects/8d153315164c4c6c9a9b47d0a3f5d684` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:24.815117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d153315164c4c6c9a9b47d0a3f5d684)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:24.817160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:24.869812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d153315164c4c6c9a9b47d0a3f5d684', 'request_id': 'req-8c665673-ba77-4913-95e9-cd5e01e577ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.877178 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d153315164c4c6c9a9b47d0a3f5d684', 'request_id': 'req-8c665673-ba77-4913-95e9-cd5e01e577ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.886433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d153315164c4c6c9a9b47d0a3f5d684', 'request_id': 'req-8c665673-ba77-4913-95e9-cd5e01e577ed'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.902800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] The token cache is being invalidate because project 8d153315164c4c6c9a9b47d0a3f5d684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:24.903029 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.904161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:24.905769 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1339/2719] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:24 2022] DELETE /identity/v3/projects/8d153315164c4c6c9a9b47d0a3f5d684 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:24.909796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:24.920957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b7cd1-f79c-4932-b776-312c3304d875 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:24.983177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:24.984250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:24.984580 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:24.984857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] PATH_INFO: `/v3/users/bdb5218fd0a848f29c7900dd5eb19e1e` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:24.986117 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdb5218fd0a848f29c7900dd5eb19e1e)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:24.988067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:25.032244 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:25.035402 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdb5218fd0a848f29c7900dd5eb19e1e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.036603 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdb5218fd0a848f29c7900dd5eb19e1e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.037404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdb5218fd0a848f29c7900dd5eb19e1e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.050796 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdb5218fd0a848f29c7900dd5eb19e1e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.058685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-80c333c2-f7b7-43a9-9f35-d434853258b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdb5218fd0a848f29c7900dd5eb19e1e'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.073052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1381/2720] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:24 2022] DELETE /identity/v3/users/bdb5218fd0a848f29c7900dd5eb19e1e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:25.380647 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:25.382099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:25.402882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c665673-ba77-4913-95e9-cd5e01e577ed admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:25.472666 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:25.473762 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:25.474048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:25.474322 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] PATH_INFO: `/v3/projects/3b63b314590a451fa9607a5ddb7dd186` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:25.475614 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b63b314590a451fa9607a5ddb7dd186)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:25.477566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:25.535043 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b63b314590a451fa9607a5ddb7dd186', 'request_id': 'req-0149f782-0c22-488f-85bb-d870868606b8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.544203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b63b314590a451fa9607a5ddb7dd186', 'request_id': 'req-0149f782-0c22-488f-85bb-d870868606b8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.554014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b63b314590a451fa9607a5ddb7dd186', 'request_id': 'req-0149f782-0c22-488f-85bb-d870868606b8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.566155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:25.576203 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] The token cache is being invalidate because project 3b63b314590a451fa9607a5ddb7dd186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:25.576713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.577673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0149f782-0c22-488f-85bb-d870868606b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:25.579352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1340/2721] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:25 2022] DELETE /identity/v3/projects/3b63b314590a451fa9607a5ddb7dd186 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:25.585201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234faad-5e05-449b-a24a-54463ad7b23d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:25.585761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234faad-5e05-449b-a24a-54463ad7b23d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:25.585761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234faad-5e05-449b-a24a-54463ad7b23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:25.605296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-9234faad-5e05-449b-a24a-54463ad7b23d None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:25.606627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9234faad-5e05-449b-a24a-54463ad7b23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:25.673658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1382/2722] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:25.737926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d95e-5921-4c86-9fd8-3a438fcb6888 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:25.738217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d95e-5921-4c86-9fd8-3a438fcb6888 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:25.738546 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161d95e-5921-4c86-9fd8-3a438fcb6888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:25.761161 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-9161d95e-5921-4c86-9fd8-3a438fcb6888 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:25.762906 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9161d95e-5921-4c86-9fd8-3a438fcb6888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:25.774050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1341/2723] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:25.778574 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234faad-5e05-449b-a24a-54463ad7b23d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:25.796719 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234faad-5e05-449b-a24a-54463ad7b23d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:25.801753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:25.802443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:25.802735 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:25.803017 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:25.803771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:25.804085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:25.805731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:25.818605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1383/2724] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:21:25.823344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d95e-5921-4c86-9fd8-3a438fcb6888 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:25.834698 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161d95e-5921-4c86-9fd8-3a438fcb6888 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:25.842620 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:25.843360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:25.843820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:25.844098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:25.844845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:25.846858 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:25.881970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1342/2725] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:25 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:25.886438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:25.899594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616706-0da1-4739-a8d5-3cfb364589ae admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:25.978149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:25.978833 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:25.979116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:25.979444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:25.980096 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:25.982031 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.002809 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1384/2726] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:25 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:26.007220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.018372 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d022274-9e28-4c31-b6f5-4b8ab2051721 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.023983 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.024697 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.024976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.025300 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.026035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.027640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.040850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1343/2727] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:26.044973 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.055557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603beb5-2b83-4319-91fb-f0f1e49d49fe admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.060326 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ec18d-e5b4-43c0-9d11-02bacdac532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.060997 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ec18d-e5b4-43c0-9d11-02bacdac532e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.061285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ec18d-e5b4-43c0-9d11-02bacdac532e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.061567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ec18d-e5b4-43c0-9d11-02bacdac532e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.062298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ec18d-e5b4-43c0-9d11-02bacdac532e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.063910 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ec18d-e5b4-43c0-9d11-02bacdac532e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.074169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1385/2728] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:26.078356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.089423 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba76d0-d013-4500-9ebb-4fcc9076be11 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.094386 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.095313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.095599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.095875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] PATH_INFO: `/v3/projects/bba357d869c84201968146f2b9149146/users/8e825dfd1b114b9ab7ce4ee1cd55c5b4/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.111464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba357d869c84201968146f2b9149146, user_id=8e825dfd1b114b9ab7ce4ee1cd55c5b4, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.114179 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.127714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1344/2729] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:26 2022] PUT /identity/v3/projects/bba357d869c84201968146f2b9149146/users/8e825dfd1b114b9ab7ce4ee1cd55c5b4/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:26.137681 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093baa3-ba4b-4a87-9620-0609c6a2627a None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.137993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093baa3-ba4b-4a87-9620-0609c6a2627a None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.138253 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093baa3-ba4b-4a87-9620-0609c6a2627a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.166375 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-3093baa3-ba4b-4a87-9620-0609c6a2627a None None] MFA Rules not processed for user `8e825dfd1b114b9ab7ce4ee1cd55c5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:26.167601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-3093baa3-ba4b-4a87-9620-0609c6a2627a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:26.180653 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:26.236958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1386/2730] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:26.241749 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.315641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4536da7-f8a2-456a-abab-b4ac8b47729f admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.322396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.323112 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.328484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.328853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.330888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.333683 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.362121 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1345/2731] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:26 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:26.366116 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093baa3-ba4b-4a87-9620-0609c6a2627a None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.381260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093baa3-ba4b-4a87-9620-0609c6a2627a None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.450537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.451220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.451504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.451783 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.452535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.454452 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.480850 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1387/2732] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:26 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:26.484854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.496503 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5300142-b6eb-426c-9f33-a0efaf02c439 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.506245 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.506934 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.509667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.509667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.509667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.510014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.521341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1346/2733] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:26.525781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.538896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c11b1c-531e-46ec-bee3-7d9fd4c9e24f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.549029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.549944 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.550227 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.550502 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] PATH_INFO: `/v3/projects/388b52ac823c45a09001b64425fc4641/users/d9d21a90d43b432089e2f5b33ac235af/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.567782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] RBAC: Authorizing `identity:create_grant(project_id=388b52ac823c45a09001b64425fc4641, user_id=d9d21a90d43b432089e2f5b33ac235af, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.570496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.584927 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1388/2734] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:26 2022] PUT /identity/v3/projects/388b52ac823c45a09001b64425fc4641/users/d9d21a90d43b432089e2f5b33ac235af/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:26.588783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.603804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1fda9e-8957-4dad-b2ac-3875b5c97b3e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.674443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c0e324-e3de-4837-8ddb-b6d4772f173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.675153 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e324-e3de-4837-8ddb-b6d4772f173e admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.675437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e324-e3de-4837-8ddb-b6d4772f173e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.675714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0e324-e3de-4837-8ddb-b6d4772f173e admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.676475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0e324-e3de-4837-8ddb-b6d4772f173e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.678885 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c0e324-e3de-4837-8ddb-b6d4772f173e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.684989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:26.697089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1347/2735] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:26.700802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.713763 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1cb402-9dd1-4182-a55d-0d9bca1e034b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.718430 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.719318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.719600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.719877 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] PATH_INFO: `/v3/projects/388b52ac823c45a09001b64425fc4641/users/d9d21a90d43b432089e2f5b33ac235af/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.721946 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] RBAC: Authorizing `identity:create_grant(project_id=388b52ac823c45a09001b64425fc4641, user_id=d9d21a90d43b432089e2f5b33ac235af, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.724704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.735787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1389/2736] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:26 2022] PUT /identity/v3/projects/388b52ac823c45a09001b64425fc4641/users/d9d21a90d43b432089e2f5b33ac235af/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:26.746669 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a393e-1337-4769-9a24-6bd4dcbf52ea None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.747222 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a393e-1337-4769-9a24-6bd4dcbf52ea None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.747531 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a393e-1337-4769-9a24-6bd4dcbf52ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.779449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-290a393e-1337-4769-9a24-6bd4dcbf52ea None None] MFA Rules not processed for user `d9d21a90d43b432089e2f5b33ac235af`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:26.780709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-290a393e-1337-4769-9a24-6bd4dcbf52ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:26.871274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1348/2737] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:26.882950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:26.884700 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:26.963529 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64311ab8-6bb9-4444-b383-6cad4882269e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:26.967856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:26.968553 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:26.968837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:26.969119 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:26.979279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:26.980733 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:26.994346 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1390/2738] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:27.072753 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a393e-1337-4769-9a24-6bd4dcbf52ea None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:27.080445 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a393e-1337-4769-9a24-6bd4dcbf52ea None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:27.085183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1640b-04b5-40ee-80f4-5b372e676118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:27.085860 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1640b-04b5-40ee-80f4-5b372e676118 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:27.086136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1640b-04b5-40ee-80f4-5b372e676118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:27.086556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1640b-04b5-40ee-80f4-5b372e676118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:27.148323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1640b-04b5-40ee-80f4-5b372e676118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:27.149960 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1640b-04b5-40ee-80f4-5b372e676118 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:27.159289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1349/2739] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:27.426138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:27.442026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:27.495770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64269481-03f3-4d70-8ade-4c404a088b45 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:27.500628 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:27.501510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:27.501802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:27.502084 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] PATH_INFO: `/v3/users/8e825dfd1b114b9ab7ce4ee1cd55c5b4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:27.503283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e825dfd1b114b9ab7ce4ee1cd55c5b4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:27.506267 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:27.557505 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e825dfd1b114b9ab7ce4ee1cd55c5b4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:27.558172 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e825dfd1b114b9ab7ce4ee1cd55c5b4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:27.558778 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e825dfd1b114b9ab7ce4ee1cd55c5b4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:27.571022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e825dfd1b114b9ab7ce4ee1cd55c5b4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:27.578532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e825dfd1b114b9ab7ce4ee1cd55c5b4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:27.591955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1391/2740] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:27 2022] DELETE /identity/v3/users/8e825dfd1b114b9ab7ce4ee1cd55c5b4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:27.596514 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:27.596810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:27.597113 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:27.615969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:27.617237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:27.678670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1350/2741] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:27.689089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:27.690616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:27.752961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fe31f-b8b9-4cae-8adf-f36e374c1e7c admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:27.757434 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:27.758085 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:27.758368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:27.758646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:27.767874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:27.769489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:27.780567 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1392/2742] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:28.067452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:28.069702 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:28.082144 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb9767-662c-4bff-bcbf-d11a3f38360c None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:28.088155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:28.089098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:28.089379 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:28.089658 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] PATH_INFO: `/v3/projects/bba357d869c84201968146f2b9149146` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:28.090888 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba357d869c84201968146f2b9149146)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:28.092892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:28.116430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:28.143364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba357d869c84201968146f2b9149146', 'request_id': 'req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.150725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba357d869c84201968146f2b9149146', 'request_id': 'req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.158284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba357d869c84201968146f2b9149146', 'request_id': 'req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.169572 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] The token cache is being invalidate because project bba357d869c84201968146f2b9149146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:28.169830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.170578 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.172662 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1351/2743] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:28 2022] DELETE /identity/v3/projects/bba357d869c84201968146f2b9149146 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:28.176554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:28.193844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4b9ef-9e70-48f5-9570-e5a4970d4e04 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:28.223772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:28.254731 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:28.256332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:28.256789 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:28.257070 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] PATH_INFO: `/v3/users/d9d21a90d43b432089e2f5b33ac235af` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:28.258353 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d21a90d43b432089e2f5b33ac235af)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:28.260298 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:28.310887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d21a90d43b432089e2f5b33ac235af'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.311542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d21a90d43b432089e2f5b33ac235af'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.312143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d21a90d43b432089e2f5b33ac235af'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.324887 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d21a90d43b432089e2f5b33ac235af'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.333670 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-c75adae0-0be7-499d-8c4c-ba46d52c377c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d21a90d43b432089e2f5b33ac235af'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.346480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1393/2744] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:28 2022] DELETE /identity/v3/users/d9d21a90d43b432089e2f5b33ac235af => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:28.627471 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:28.629011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:28.644001 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108e8e0-423f-4bf6-a812-b33d7e1a6d58 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:28.705820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:28.706690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:28.706977 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:28.707253 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] PATH_INFO: `/v3/projects/388b52ac823c45a09001b64425fc4641` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:28.708464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] RBAC: Authorizing `identity:delete_project(project_id=388b52ac823c45a09001b64425fc4641)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:28.711157 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:28.761863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388b52ac823c45a09001b64425fc4641', 'request_id': 'req-7043b427-2579-47a9-8516-a6a5c01f413e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.769289 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388b52ac823c45a09001b64425fc4641', 'request_id': 'req-7043b427-2579-47a9-8516-a6a5c01f413e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.778284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388b52ac823c45a09001b64425fc4641', 'request_id': 'req-7043b427-2579-47a9-8516-a6a5c01f413e'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.789569 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] The token cache is being invalidate because project 388b52ac823c45a09001b64425fc4641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:28.789862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.790515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7043b427-2579-47a9-8516-a6a5c01f413e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:28.792085 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1352/2745] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:28 2022] DELETE /identity/v3/projects/388b52ac823c45a09001b64425fc4641 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:28.797003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec8683-31cd-4144-a421-955cd8352b5e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:28.797508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec8683-31cd-4144-a421-955cd8352b5e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:28.797624 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec8683-31cd-4144-a421-955cd8352b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:28.816492 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-a6ec8683-31cd-4144-a421-955cd8352b5e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:28.817708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a6ec8683-31cd-4144-a421-955cd8352b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:28.880318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1394/2746] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:28.888998 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2f35-3bd5-4381-9b74-a9e024e9606f None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:28.889295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2f35-3bd5-4381-9b74-a9e024e9606f None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:28.889574 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e2f35-3bd5-4381-9b74-a9e024e9606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:28.912367 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7c3e2f35-3bd5-4381-9b74-a9e024e9606f None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:28.914136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7c3e2f35-3bd5-4381-9b74-a9e024e9606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:28.922757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1353/2747] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:28.926840 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec8683-31cd-4144-a421-955cd8352b5e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:28.937658 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec8683-31cd-4144-a421-955cd8352b5e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:28.942484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:28.943802 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:28.944214 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:28.944562 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:28.945368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:28.945764 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:28.947413 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:28.960677 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1395/2748] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:21:28.965165 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2f35-3bd5-4381-9b74-a9e024e9606f None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:28.974963 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e2f35-3bd5-4381-9b74-a9e024e9606f None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:28.979863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:28.980561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:28.980865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:28.981142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:28.981856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:28.983846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:29.012418 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1354/2749] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:28 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:29.016561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:29.027558 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c0baa-32f9-46a4-9c08-65fada742e0e admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:29.069720 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:29.092384 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:29.093062 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:29.093344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:29.093616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:29.094313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:29.096221 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:29.117323 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1396/2750] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:29 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:29.121579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:29.132731 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f638ea-1f33-493a-8537-2d15528309f8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:29.137689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:29.138359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:29.138643 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:29.138947 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:29.139670 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:29.141416 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:29.143610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:29.156592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1355/2751] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:29.158412 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:29.169612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f3ec98-64eb-4dd4-aa6b-74d8c38ea3cf admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:29.174311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81a01-4bd0-4b93-9a00-64a7bdefd45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:29.174968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81a01-4bd0-4b93-9a00-64a7bdefd45e admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:29.175252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81a01-4bd0-4b93-9a00-64a7bdefd45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:29.175528 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81a01-4bd0-4b93-9a00-64a7bdefd45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:29.176284 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f81a01-4bd0-4b93-9a00-64a7bdefd45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:29.178357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f81a01-4bd0-4b93-9a00-64a7bdefd45e admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:29.189865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1397/2752] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:29.194323 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:29.204566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c7476-0607-4ec7-bd09-e92ead6548d4 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:29.209800 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:29.210667 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:29.211088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:29.211371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] PATH_INFO: `/v3/projects/49e2b5e35d58427294010aaa275e18f2/users/fd29b66e18914928b2730c4b9420eee1/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:29.227398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e2b5e35d58427294010aaa275e18f2, user_id=fd29b66e18914928b2730c4b9420eee1, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:29.230098 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:29.242838 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1356/2753] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:29 2022] PUT /identity/v3/projects/49e2b5e35d58427294010aaa275e18f2/users/fd29b66e18914928b2730c4b9420eee1/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:29.253259 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891a6a-7124-4b86-996a-929eaae64f4d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:29.253570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891a6a-7124-4b86-996a-929eaae64f4d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:29.253875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d891a6a-7124-4b86-996a-929eaae64f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:29.284047 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-6d891a6a-7124-4b86-996a-929eaae64f4d None None] MFA Rules not processed for user `fd29b66e18914928b2730c4b9420eee1`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:29.285293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-6d891a6a-7124-4b86-996a-929eaae64f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:29.353393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1398/2754] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:29.366817 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:29.368675 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:29.430783 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54699292-6556-4a54-8fa4-8b963ee15ff1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:29.435221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:29.436119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:29.436474 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:29.436845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:29.446345 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:29.447792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:29.457276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1357/2755] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:39.349092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:39.453542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:42.067798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:42.068332 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:42.068432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:42.086606 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:42.087816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:42.143443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1399/2756] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:21:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:42.194593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:42.196020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:42.271064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d277a-b568-4fe1-8c9e-e0bdbd6adc7e service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:42.276216 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:42.276865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:42.277148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:42.277424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:42.286087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:42.287679 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:42.295755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1358/2757] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:21:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:21:52.135937 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=25 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:52.292588 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=32 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:53.705825 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:53.707407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:53.802552 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ccfd5-1ab7-486a-984d-d17c76336880 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:53.807962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:53.808881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:53.809164 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:53.809440 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] PATH_INFO: `/v3/users/6e3ce554eeb34e75890c75aefe766d65` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:53.810716 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3ce554eeb34e75890c75aefe766d65)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:53.813365 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:53.890134 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3ce554eeb34e75890c75aefe766d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:53.892252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3ce554eeb34e75890c75aefe766d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:53.893368 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3ce554eeb34e75890c75aefe766d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:53.897751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:53.908561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef11965-592d-4b06-9111-b3a0614b0ea6 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:53.913678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3ce554eeb34e75890c75aefe766d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:53.914116 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:53.915185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:53.915595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:53.915872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] PATH_INFO: `/v3/users/fd29b66e18914928b2730c4b9420eee1` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:53.917136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd29b66e18914928b2730c4b9420eee1)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:53.919282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:53.924889 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6b5d5882-ef35-482c-b994-ae442cb1e610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3ce554eeb34e75890c75aefe766d65'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:53.942518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1400/2758] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:53 2022] DELETE /identity/v3/users/6e3ce554eeb34e75890c75aefe766d65 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:53.947376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:53.947740 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:53.948088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:53.975299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:53.976845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:54.001556 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd29b66e18914928b2730c4b9420eee1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.003007 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd29b66e18914928b2730c4b9420eee1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.003926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd29b66e18914928b2730c4b9420eee1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.021129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd29b66e18914928b2730c4b9420eee1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.033327 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-7d9f3c1a-552c-4725-8023-91441424581d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd29b66e18914928b2730c4b9420eee1'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.049298 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1359/2759] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:21:53 2022] DELETE /identity/v3/users/fd29b66e18914928b2730c4b9420eee1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:54.054358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea269762-1e19-4847-b7e9-6cc6771dd4d1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:54.054965 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea269762-1e19-4847-b7e9-6cc6771dd4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:54.055501 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea269762-1e19-4847-b7e9-6cc6771dd4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:54.071436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1401/2760] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:54.085875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ea269762-1e19-4847-b7e9-6cc6771dd4d1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:54.085875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ea269762-1e19-4847-b7e9-6cc6771dd4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:54.097124 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:54.098854 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:54.127300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:54.193663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bfa79-acc9-4051-acc3-7f18d8b84f79 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:54.216631 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1360/2761] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:54.227979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea269762-1e19-4847-b7e9-6cc6771dd4d1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:54.262030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:54.262771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:54.263174 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:54.263498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:54.279301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:54.283018 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:54.297507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea269762-1e19-4847-b7e9-6cc6771dd4d1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:54.299195 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1402/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:21:54.318364 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:54.319031 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:54.319316 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:54.319590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:54.337285 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:54.338314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:54.350318 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1361/2763] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:54.724347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:54.726490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:54.748500 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42879b-dd61-423b-8a5e-57aea6bb3cf1 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:54.757510 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:54.758445 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:54.758672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:54.759101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] PATH_INFO: `/v3/projects/5c97e7e74d474124be6afd93cdba9eff` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:54.760167 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c97e7e74d474124be6afd93cdba9eff)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:54.762650 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:54.765978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:54.769064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:54.799283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13b0c6-7d7e-4c2b-8ab2-00d416539259 service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:54.809099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:54.810577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:54.810577 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:54.811528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] PATH_INFO: `/v3/projects/49e2b5e35d58427294010aaa275e18f2` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:54.813865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e2b5e35d58427294010aaa275e18f2)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:54.816236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:54.833654 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:54.839696 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c97e7e74d474124be6afd93cdba9eff', 'request_id': 'req-161395f1-8fb6-4061-96ca-87572ede4719'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.847985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c97e7e74d474124be6afd93cdba9eff', 'request_id': 'req-161395f1-8fb6-4061-96ca-87572ede4719'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.860163 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c97e7e74d474124be6afd93cdba9eff', 'request_id': 'req-161395f1-8fb6-4061-96ca-87572ede4719'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.881680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] The token cache is being invalidate because project 5c97e7e74d474124be6afd93cdba9eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:54.882081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.882896 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-161395f1-8fb6-4061-96ca-87572ede4719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.888347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1403/2764] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:54 2022] DELETE /identity/v3/projects/5c97e7e74d474124be6afd93cdba9eff => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:54.899322 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8280-b3c2-444f-933f-00b6600e50ad None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:54.899744 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8280-b3c2-444f-933f-00b6600e50ad None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:54.900594 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e8280-b3c2-444f-933f-00b6600e50ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:54.907064 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e2b5e35d58427294010aaa275e18f2', 'request_id': 'req-e4435895-4832-4081-9f16-6c4252167eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.915925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e2b5e35d58427294010aaa275e18f2', 'request_id': 'req-e4435895-4832-4081-9f16-6c4252167eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.924854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e2b5e35d58427294010aaa275e18f2', 'request_id': 'req-e4435895-4832-4081-9f16-6c4252167eb8'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.925523 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-5a1e8280-b3c2-444f-933f-00b6600e50ad None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:54.926773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-5a1e8280-b3c2-444f-933f-00b6600e50ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:54.941185 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] The token cache is being invalidate because project 49e2b5e35d58427294010aaa275e18f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:21:54.941583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.942191 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-e4435895-4832-4081-9f16-6c4252167eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:21:54.944466 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1362/2765] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:21:54 2022] DELETE /identity/v3/projects/49e2b5e35d58427294010aaa275e18f2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:55.044038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1404/2766] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:55.055142 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbde7d-bf49-441c-9046-ee5f0178bfd1 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.055807 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbde7d-bf49-441c-9046-ee5f0178bfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.056363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbde7d-bf49-441c-9046-ee5f0178bfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.081204 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-7cdbde7d-bf49-441c-9046-ee5f0178bfd1 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:55.082462 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-7cdbde7d-bf49-441c-9046-ee5f0178bfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:55.100283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1363/2767] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:55.101149 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e8280-b3c2-444f-933f-00b6600e50ad None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.108004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:55.114607 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e8280-b3c2-444f-933f-00b6600e50ad None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.124305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.126009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.127040 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.127547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] PATH_INFO: `/v3/domains` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.128851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80416) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:21:55.129416 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.131662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.161159 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1405/2768] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:21:55.169284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbde7d-bf49-441c-9046-ee5f0178bfd1 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.182475 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbde7d-bf49-441c-9046-ee5f0178bfd1 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.191784 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.193509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.193908 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.194335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.195136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.197680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.243529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1364/2769] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:55 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:55.245004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.256063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16daf4fe-5850-4ccb-a7e0-4d8a6860a18a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.321759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.322429 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.322915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.323160 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.323968 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.326034 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.350063 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1406/2770] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:55 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:55.353886 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.364856 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcb55a-e2ba-4d93-8707-3ba7e59c9509 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.370661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.371402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.371889 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.372071 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.373206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.375077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.387590 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1365/2771] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:55.393028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.410232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c8b70-d591-48e5-8788-c44248dfd48f admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.418190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd766398-ec5e-41a2-80ab-0d31961a305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.419411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766398-ec5e-41a2-80ab-0d31961a305d admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.419932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766398-ec5e-41a2-80ab-0d31961a305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.420548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd766398-ec5e-41a2-80ab-0d31961a305d admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.421909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd766398-ec5e-41a2-80ab-0d31961a305d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.423987 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd766398-ec5e-41a2-80ab-0d31961a305d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.441135 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1407/2772] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:55.444992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.458757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd99a0-e5ba-47e5-96d1-92fb0dc44777 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.465217 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.466477 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.466760 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.467148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] PATH_INFO: `/v3/projects/09bbce92df2f422488d3078279b2727f/users/113338400e3340c397abd045f7ba51f6/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.487061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09bbce92df2f422488d3078279b2727f, user_id=113338400e3340c397abd045f7ba51f6, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.490649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.510063 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1366/2773] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:55 2022] PUT /identity/v3/projects/09bbce92df2f422488d3078279b2727f/users/113338400e3340c397abd045f7ba51f6/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:55.522518 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625364-8a73-4286-88ad-f203c1ce318c None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.523474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625364-8a73-4286-88ad-f203c1ce318c None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.523844 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9625364-8a73-4286-88ad-f203c1ce318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.553196 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d9625364-8a73-4286-88ad-f203c1ce318c None None] MFA Rules not processed for user `113338400e3340c397abd045f7ba51f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:55.554181 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d9625364-8a73-4286-88ad-f203c1ce318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:55.634690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1408/2774] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:55.639515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.714873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce142687-5fe8-4c5b-80a9-718f5647d076 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.720736 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.721484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.721840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.722194 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.722967 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.724997 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.757518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1367/2775] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:55 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:55.759962 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9625364-8a73-4286-88ad-f203c1ce318c None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.774961 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9625364-8a73-4286-88ad-f203c1ce318c None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.846701 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:55.855136 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.856234 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.856597 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.856948 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.857782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.860058 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.892006 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1409/2776] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:55 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:55.894650 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.909709 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ea4b2-2a3f-4745-b4bd-65a266394d4a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.915593 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.916299 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.916589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.916870 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.917604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.919223 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.938449 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1368/2777] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:55.939300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.955003 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e12d5e-b57e-4e40-8bb1-5269baea301b admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:55.961121 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849a20c-80c6-4cde-b7c9-89333eaba54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:55.961956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849a20c-80c6-4cde-b7c9-89333eaba54a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:55.962251 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849a20c-80c6-4cde-b7c9-89333eaba54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:55.962530 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849a20c-80c6-4cde-b7c9-89333eaba54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:55.963266 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849a20c-80c6-4cde-b7c9-89333eaba54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:55.964935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849a20c-80c6-4cde-b7c9-89333eaba54a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:55.982595 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1410/2778] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:55.984133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:55.994867 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a48016-3ec4-4a23-9afb-87a7434dc5ec admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.000863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.002024 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.002469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.002601 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] PATH_INFO: `/v3/projects/8c59f9b46e3c454bb906e5cb6f63883b/users/ae37d546125d4779b6fec96439a45fc4/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.006030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:56.023417 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c59f9b46e3c454bb906e5cb6f63883b, user_id=ae37d546125d4779b6fec96439a45fc4, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.026892 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.042830 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1369/2779] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:55 2022] PUT /identity/v3/projects/8c59f9b46e3c454bb906e5cb6f63883b/users/ae37d546125d4779b6fec96439a45fc4/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:56.053225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61322e2-cdc0-4954-9720-e3342e970f1e None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.053458 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61322e2-cdc0-4954-9720-e3342e970f1e None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.053688 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61322e2-cdc0-4954-9720-e3342e970f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.084992 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d61322e2-cdc0-4954-9720-e3342e970f1e None None] MFA Rules not processed for user `ae37d546125d4779b6fec96439a45fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:56.086279 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d61322e2-cdc0-4954-9720-e3342e970f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:56.172293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1411/2780] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:56.177275 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:56.265785 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a98036a-6386-4291-8b88-b0dbf1da0159 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.273581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.275167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.275454 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.275845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.277208 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.279689 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.313263 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1370/2781] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:21:56 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:21:56.317405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61322e2-cdc0-4954-9720-e3342e970f1e None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:56.329767 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61322e2-cdc0-4954-9720-e3342e970f1e None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.391547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.392352 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.392742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.393118 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.393920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.395940 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.420883 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1412/2782] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:21:56 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:21:56.425155 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:56.438716 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96745f2-3eb1-469a-bb25-d767373d1798 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.444350 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.445227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.445507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.445781 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.450269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.450269 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.461287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1371/2783] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:21:56.465816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:56.477225 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accbf098-7ad6-470d-a19e-c9de69443194 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.483478 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.485359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.485583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.485870 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] PATH_INFO: `/v3/projects/320e89a0a54d41d09ac59a93516adfe2/users/c9dd46b8693949bc8ffed6549f1a9eeb/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.505173 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] RBAC: Authorizing `identity:create_grant(project_id=320e89a0a54d41d09ac59a93516adfe2, user_id=c9dd46b8693949bc8ffed6549f1a9eeb, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.509357 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.525210 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1413/2784] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:56 2022] PUT /identity/v3/projects/320e89a0a54d41d09ac59a93516adfe2/users/c9dd46b8693949bc8ffed6549f1a9eeb/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:21:56.529353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:56.541286 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0869aec-b9ad-477e-879d-e40f17e67c3d admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.616496 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f827ca-f41a-490a-9c17-a5aefc0e7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.617261 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f827ca-f41a-490a-9c17-a5aefc0e7664 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.617613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f827ca-f41a-490a-9c17-a5aefc0e7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.617958 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f827ca-f41a-490a-9c17-a5aefc0e7664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.618877 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f827ca-f41a-490a-9c17-a5aefc0e7664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.620609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f827ca-f41a-490a-9c17-a5aefc0e7664 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.632611 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1372/2785] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:21:56.637224 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:56.649383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6d4f0-de5d-4f8f-8fed-a3c5a4a1763a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.654489 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.656201 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.656893 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.657333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] PATH_INFO: `/v3/projects/320e89a0a54d41d09ac59a93516adfe2/users/c9dd46b8693949bc8ffed6549f1a9eeb/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.659666 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] RBAC: Authorizing `identity:create_grant(project_id=320e89a0a54d41d09ac59a93516adfe2, user_id=c9dd46b8693949bc8ffed6549f1a9eeb, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.662490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.674949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1414/2786] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:21:56 2022] PUT /identity/v3/projects/320e89a0a54d41d09ac59a93516adfe2/users/c9dd46b8693949bc8ffed6549f1a9eeb/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:21:56.690508 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.690707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.691396 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.723014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] MFA Rules not processed for user `c9dd46b8693949bc8ffed6549f1a9eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:56.724309 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:56.778237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:56.811738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1373/2787] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:21:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:21:56.827393 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:56.830075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:56.857611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:21:56.909768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae4bce-9c06-4240-8b5c-c217cdd7a40d admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:56.913656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d67f0-ed7d-4257-b45b-ece03b020459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:56.914312 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d67f0-ed7d-4257-b45b-ece03b020459 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:56.914747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d67f0-ed7d-4257-b45b-ece03b020459 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:56.915027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d67f0-ed7d-4257-b45b-ece03b020459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:56.985868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d67f0-ed7d-4257-b45b-ece03b020459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:56.987220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d67f0-ed7d-4257-b45b-ece03b020459 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:56.998786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1415/2788] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:58.537940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:58.539359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:58.552360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f0a80-a1d8-4c96-add7-92caa456cfc2 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:58.556136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:58.556810 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:58.557095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:58.557373 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:58.622956 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:58.625083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:58.635136 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1374/2789] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:21:58.958232 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb359-326a-4616-8862-871a029bfedd None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:58.958736 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb359-326a-4616-8862-871a029bfedd None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:58.958841 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bb359-326a-4616-8862-871a029bfedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:58.977750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-8f2bb359-326a-4616-8862-871a029bfedd None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:21:58.979030 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8f2bb359-326a-4616-8862-871a029bfedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:59.045663 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1416/2790] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 16 21:21:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:21:59.058558 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:59.060595 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:21:59.135879 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dec0-4859-4b31-8a75-bc99fac9b287 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:59.141704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:59.142227 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:59.142505 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:59.142778 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:59.150939 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:59.152719 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:59.165579 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1375/2791] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:21:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:21:59.188905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bb359-326a-4616-8862-871a029bfedd None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:21:59.198728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bb359-326a-4616-8862-871a029bfedd None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:21:59.202242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:21:59.203404 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:21:59.203707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:21:59.204120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:21:59.213583 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:21:59.215104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:21:59.226138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1417/2792] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:21:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:01.115319 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:01.116690 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:01.188616 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd71b95-0cf9-4dfd-b0d2-8b693ffc65e7 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:01.193235 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:01.194111 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.194389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.194660 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] PATH_INFO: `/v3/users/105646575b4748a88700db4117174c0c` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.195845 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=105646575b4748a88700db4117174c0c)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:01.197820 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:01.208547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=100 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:01.245479 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105646575b4748a88700db4117174c0c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.246125 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105646575b4748a88700db4117174c0c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.246735 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105646575b4748a88700db4117174c0c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.259398 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105646575b4748a88700db4117174c0c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.267175 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-0383a87a-1e2f-46d5-ae6b-4e2673bfb45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105646575b4748a88700db4117174c0c'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.279374 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1376/2793] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:01 2022] DELETE /identity/v3/users/105646575b4748a88700db4117174c0c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:01.451369 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:01.463791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff310c-9526-4970-a870-4ee293ea6b56 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:01.523807 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:01.524705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.524993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.525268 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] PATH_INFO: `/v3/projects/404175dcaa0144fab98ad34e4834de35` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.526474 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404175dcaa0144fab98ad34e4834de35)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:01.528426 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:01.535635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:01.576868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404175dcaa0144fab98ad34e4834de35', 'request_id': 'req-6118aaf2-9d2d-42a1-9c87-babf01bedf58'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.583128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404175dcaa0144fab98ad34e4834de35', 'request_id': 'req-6118aaf2-9d2d-42a1-9c87-babf01bedf58'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.590425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404175dcaa0144fab98ad34e4834de35', 'request_id': 'req-6118aaf2-9d2d-42a1-9c87-babf01bedf58'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.601075 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] The token cache is being invalidate because project 404175dcaa0144fab98ad34e4834de35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:01.601389 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.602036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6118aaf2-9d2d-42a1-9c87-babf01bedf58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:01.603641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1418/2794] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:01 2022] DELETE /identity/v3/projects/404175dcaa0144fab98ad34e4834de35 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:01.608552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d79ec-4c84-428e-9736-99678bc1cd22 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.608849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d79ec-4c84-428e-9736-99678bc1cd22 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.609701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d79ec-4c84-428e-9736-99678bc1cd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.631061 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5d9d79ec-4c84-428e-9736-99678bc1cd22 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:01.632310 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5d9d79ec-4c84-428e-9736-99678bc1cd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:01.695712 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1377/2795] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:01.704385 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400ec2-89cf-42c1-92c9-14b15584cf82 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.704669 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400ec2-89cf-42c1-92c9-14b15584cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.704949 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97400ec2-89cf-42c1-92c9-14b15584cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.724021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-97400ec2-89cf-42c1-92c9-14b15584cf82 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:01.725328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-97400ec2-89cf-42c1-92c9-14b15584cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:01.733185 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1419/2796] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:01.737840 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d79ec-4c84-428e-9736-99678bc1cd22 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:01.748266 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d79ec-4c84-428e-9736-99678bc1cd22 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:01.753992 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:01.754725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.755072 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.755412 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.756147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:22:01.756492 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:01.758079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:01.776002 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1378/2797] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:22:01.782647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400ec2-89cf-42c1-92c9-14b15584cf82 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:01.787632 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97400ec2-89cf-42c1-92c9-14b15584cf82 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:01.792432 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:01.793092 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.793378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.793657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.794364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:01.796285 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:01.824359 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1420/2798] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:22:01 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:01.830917 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:01.840973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650a231-b8d3-487d-95b4-50155c673432 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:01.904058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:01.904771 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.905056 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.905332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.906553 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:01.908495 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:01.929411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1379/2799] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:22:01 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:01.933587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:01.944680 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2166a2-03bf-4090-a22d-4e240beec3fc admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:01.949732 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:01.950420 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.950798 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:01.951088 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:01.951827 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:01.954436 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:01.966965 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1421/2800] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:22:01.972563 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:01.981776 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:01.990249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3b6bc-8495-402e-980c-9b457ca4db46 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:01.998893 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87731dc4-2606-4487-a3fc-8b65d143e7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:01.999589 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731dc4-2606-4487-a3fc-8b65d143e7af admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:01.999920 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731dc4-2606-4487-a3fc-8b65d143e7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:02.000280 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731dc4-2606-4487-a3fc-8b65d143e7af admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:02.001017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87731dc4-2606-4487-a3fc-8b65d143e7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:02.002780 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87731dc4-2606-4487-a3fc-8b65d143e7af admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:02.013900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1380/2801] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:22:02.018171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:02.029787 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f1a78-5378-4f8f-8a1e-16e28b223a8a admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:02.036043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:02.037093 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:02.037444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:02.037786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] PATH_INFO: `/v3/projects/7f9f61ec956d45e88b7e5f16e9132a56/users/9683d5b707014851a89959b5640fcac7/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:02.054137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9f61ec956d45e88b7e5f16e9132a56, user_id=9683d5b707014851a89959b5640fcac7, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:02.056872 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:02.071804 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1422/2802] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:22:02 2022] PUT /identity/v3/projects/7f9f61ec956d45e88b7e5f16e9132a56/users/9683d5b707014851a89959b5640fcac7/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:02.082306 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:02.082602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:02.082903 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:02.118866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] MFA Rules not processed for user `9683d5b707014851a89959b5640fcac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:02.118866 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:02.181613 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1381/2803] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:02.192926 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:02.194592 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:02.255302 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd26ae-df3b-4408-a2e7-acc72550b3fe admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:02.259137 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:02.259791 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:02.260079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:02.260521 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:02.270354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:02.271786 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:02.283089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1423/2804] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:03.076150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:03.077586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.143936 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884b8a4-bca0-4df4-9697-c3ba8818ad65 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:03.145077 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:03.146462 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.148088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:03.148999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.149284 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.149565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] PATH_INFO: `/v3/users/113338400e3340c397abd045f7ba51f6` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.150757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] RBAC: Authorizing `identity:delete_user(user_id=113338400e3340c397abd045f7ba51f6)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:03.152757 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:03.162314 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196000cb-0d92-4e2a-89eb-431314352324 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:03.166921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:03.167795 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.168083 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.168394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] PATH_INFO: `/v3/users/607fc3a0a3404958bb2d700d713f688c` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.169587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=607fc3a0a3404958bb2d700d713f688c)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:03.171494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:03.200610 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113338400e3340c397abd045f7ba51f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.201265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113338400e3340c397abd045f7ba51f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.201890 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113338400e3340c397abd045f7ba51f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.203657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:03.216742 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113338400e3340c397abd045f7ba51f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.224536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2ad8ba16-a132-4fba-9541-086aa8e5a19a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113338400e3340c397abd045f7ba51f6'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.226481 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '607fc3a0a3404958bb2d700d713f688c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.227132 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '607fc3a0a3404958bb2d700d713f688c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.227747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '607fc3a0a3404958bb2d700d713f688c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.237159 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1382/2805] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:03 2022] DELETE /identity/v3/users/113338400e3340c397abd045f7ba51f6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:03.240242 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '607fc3a0a3404958bb2d700d713f688c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.241714 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.242206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.242494 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.248254 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-b444ae04-0149-4a13-9ca9-23a6cb185486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '607fc3a0a3404958bb2d700d713f688c'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.248854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:03.263292 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1424/2806] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:03 2022] DELETE /identity/v3/users/607fc3a0a3404958bb2d700d713f688c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:22:03.266353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:03.266353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.267638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.267955 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.268671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.286448 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:03.287656 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.324989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1383/2807] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:03.335882 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:03.337313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.349635 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1425/2808] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:03.360561 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:03.361928 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.395699 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe13c-d5ac-4028-9d4e-46ae9a97b754 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:03.399401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5757e167-2357-496a-9b9e-4b40489690f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:03.400050 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757e167-2357-496a-9b9e-4b40489690f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.400369 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757e167-2357-496a-9b9e-4b40489690f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.400649 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5757e167-2357-496a-9b9e-4b40489690f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.410515 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757e167-2357-496a-9b9e-4b40489690f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:03.411954 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5757e167-2357-496a-9b9e-4b40489690f9 service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:03.419120 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c98cb4-760c-43d8-8ea0-ac87b88d9948 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:03.421537 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1384/2809] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:22:03.423016 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:03.423711 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.423951 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.424258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.434296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:03.435654 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:03.446622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1426/2810] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:22:03.637755 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.638182 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.638541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.662096 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] MFA Rules not processed for user `9683d5b707014851a89959b5640fcac7`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:03.663437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.746909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1385/2811] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:03.812705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:03.814148 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.841014 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967a356-9cd3-4309-bb81-6f0309a19570 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:03.846846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:03.848894 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:03.856289 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:03.857453 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.857828 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.858197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] PATH_INFO: `/v3/projects/09bbce92df2f422488d3078279b2727f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.860071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09bbce92df2f422488d3078279b2727f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:03.862676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:03.866765 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c376918-87e5-4bf0-b910-9481f1314536 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:03.872207 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:03.873356 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.873676 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.873969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] PATH_INFO: `/v3/projects/68b317eceae548bea95b3e248730f709` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.875314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b317eceae548bea95b3e248730f709)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:03.877402 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:03.934705 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:03.938896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b317eceae548bea95b3e248730f709', 'request_id': 'req-9e3e679a-8138-4b43-9b20-b413f861325f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.942638 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:03.946790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b317eceae548bea95b3e248730f709', 'request_id': 'req-9e3e679a-8138-4b43-9b20-b413f861325f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.948193 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09bbce92df2f422488d3078279b2727f', 'request_id': 'req-ffde664d-fc5d-4fb3-b0c7-64117443cb33'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.957832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09bbce92df2f422488d3078279b2727f', 'request_id': 'req-ffde664d-fc5d-4fb3-b0c7-64117443cb33'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.958414 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b317eceae548bea95b3e248730f709', 'request_id': 'req-9e3e679a-8138-4b43-9b20-b413f861325f'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.966535 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09bbce92df2f422488d3078279b2727f', 'request_id': 'req-ffde664d-fc5d-4fb3-b0c7-64117443cb33'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.973019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] The token cache is being invalidate because project 68b317eceae548bea95b3e248730f709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:03.973395 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.974224 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9e3e679a-8138-4b43-9b20-b413f861325f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.976233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1386/2812] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:03 2022] DELETE /identity/v3/projects/68b317eceae548bea95b3e248730f709 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:03.979108 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] The token cache is being invalidate because project 09bbce92df2f422488d3078279b2727f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:03.979532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.980394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:03.980852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd4e6-c95c-4eea-941b-a428a3fcd1b6 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:03.981147 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd4e6-c95c-4eea-941b-a428a3fcd1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:03.981430 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd4e6-c95c-4eea-941b-a428a3fcd1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:03.982396 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1427/2813] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:03 2022] DELETE /identity/v3/projects/09bbce92df2f422488d3078279b2727f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:03.986296 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:03.987753 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.004878 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-36cbd4e6-c95c-4eea-941b-a428a3fcd1b6 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:04.006119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-36cbd4e6-c95c-4eea-941b-a428a3fcd1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.066640 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde664d-fc5d-4fb3-b0c7-64117443cb33 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.071379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.072313 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.072598 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.072878 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] PATH_INFO: `/v3/users/ae37d546125d4779b6fec96439a45fc4` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.074421 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae37d546125d4779b6fec96439a45fc4)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.076880 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.083701 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1387/2814] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:22:04.085925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c52c-09e2-4543-928c-a432685edd01 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.086220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c52c-09e2-4543-928c-a432685edd01 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.086497 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c52c-09e2-4543-928c-a432685edd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.107237 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-5bb1c52c-09e2-4543-928c-a432685edd01 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:04.108529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-5bb1c52c-09e2-4543-928c-a432685edd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.118129 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1388/2815] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:04.122295 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c52c-09e2-4543-928c-a432685edd01 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.133103 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c52c-09e2-4543-928c-a432685edd01 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.139921 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae37d546125d4779b6fec96439a45fc4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.140850 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.141032 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae37d546125d4779b6fec96439a45fc4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.141759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae37d546125d4779b6fec96439a45fc4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.141891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.142042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.142328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.143124 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:22:04.143441 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.146354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.159276 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae37d546125d4779b6fec96439a45fc4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.159831 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1389/2816] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 21:22:04.164240 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.165994 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.174952 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae37d546125d4779b6fec96439a45fc4'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.180688 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c96e4-0346-4839-86b2-9c02451f09fd admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.186030 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.186704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.186989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.187942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] PATH_INFO: `/v3/projects` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.188691 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.191380 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.192794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1428/2817] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:03 2022] DELETE /identity/v3/users/ae37d546125d4779b6fec96439a45fc4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:22:04.234734 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1390/2818] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:22:04 2022] POST /identity/v3/projects => generated 399 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:04.236950 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.316252 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:04.332660 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ce579-1d01-4e41-9609-63a63047a647 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.418874 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.419550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.419835 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.420340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] PATH_INFO: `/v3/users` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.421036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.423506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.446830 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1429/2819] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:22:04 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:04.450696 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.461339 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85471fb0-ef75-4d48-a1be-b8ec7e8a453e admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.466288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.466899 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.467189 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.467469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.468233 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.470340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.484529 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1391/2820] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:22:04.486293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.499005 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf73213-c0ba-4abe-b8be-802d30bbc171 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.504929 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.506187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.506771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.507245 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.508089 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.510197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.524143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1430/2821] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:22:04.527052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.528942 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.529618 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.542009 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdcb60e-9eed-45cc-a2df-a172f0add189 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.549409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290f51-a920-4fcf-959f-b81d7cae7ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.550468 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290f51-a920-4fcf-959f-b81d7cae7ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.550862 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290f51-a920-4fcf-959f-b81d7cae7ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.551188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290f51-a920-4fcf-959f-b81d7cae7ca3 admin admin] PATH_INFO: `/v3/projects/51ef86872f0e4a59b5ed0a34b04eef82/users/07e28d544a0a48b3ad4a4caf902fb18f/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.554842 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a8834-ad1b-4e8f-bf99-78edcead1328 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.568148 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.569062 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.569461 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.569684 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] PATH_INFO: `/v3/projects/8c59f9b46e3c454bb906e5cb6f63883b` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.570747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58290f51-a920-4fcf-959f-b81d7cae7ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ef86872f0e4a59b5ed0a34b04eef82, user_id=07e28d544a0a48b3ad4a4caf902fb18f, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.571511 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c59f9b46e3c454bb906e5cb6f63883b)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.573467 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58290f51-a920-4fcf-959f-b81d7cae7ca3 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.573608 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.600560 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1431/2822] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:22:04 2022] PUT /identity/v3/projects/51ef86872f0e4a59b5ed0a34b04eef82/users/07e28d544a0a48b3ad4a4caf902fb18f/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 21:22:04.616587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.616996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.617414 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.637925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c59f9b46e3c454bb906e5cb6f63883b', 'request_id': 'req-269ec74c-7da5-4f11-a8a8-463a2e591267'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.646542 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c59f9b46e3c454bb906e5cb6f63883b', 'request_id': 'req-269ec74c-7da5-4f11-a8a8-463a2e591267'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.647138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] MFA Rules not processed for user `07e28d544a0a48b3ad4a4caf902fb18f`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:04.648403 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.657003 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c59f9b46e3c454bb906e5cb6f63883b', 'request_id': 'req-269ec74c-7da5-4f11-a8a8-463a2e591267'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.670044 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] The token cache is being invalidate because project 8c59f9b46e3c454bb906e5cb6f63883b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:04.670340 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.671250 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.676790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1392/2823] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:04 2022] DELETE /identity/v3/projects/8c59f9b46e3c454bb906e5cb6f63883b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:04.678354 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.679789 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.686199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:04.724347 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1432/2824] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:22:04.736886 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:04.739067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:04.761931 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ec74c-7da5-4f11-a8a8-463a2e591267 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.767814 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.768727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.769011 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.769288 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] PATH_INFO: `/v3/users/c9dd46b8693949bc8ffed6549f1a9eeb` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.771060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9dd46b8693949bc8ffed6549f1a9eeb)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.773221 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.796350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:04.810354 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f830a-577c-4432-8e1a-5a39a4ccd6c0 None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:04.816914 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:04.817776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:04.818220 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:04.818770 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:04.829832 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9dd46b8693949bc8ffed6549f1a9eeb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.830523 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9dd46b8693949bc8ffed6549f1a9eeb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.831154 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9dd46b8693949bc8ffed6549f1a9eeb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.832712 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:04.834294 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:04.845199 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9dd46b8693949bc8ffed6549f1a9eeb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.847072 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1433/2825] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 21:22:04.853184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-66a0c749-21bf-4c0f-9bd1-08e6aa045c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9dd46b8693949bc8ffed6549f1a9eeb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:04.878559 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1393/2826] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:04 2022] DELETE /identity/v3/users/c9dd46b8693949bc8ffed6549f1a9eeb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:05.205438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:05.225508 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27880694-05ea-4d70-ac53-9723e84c3b03 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:05.288480 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:05.289386 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.289676 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.289976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] PATH_INFO: `/v3/projects/320e89a0a54d41d09ac59a93516adfe2` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.291319 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=320e89a0a54d41d09ac59a93516adfe2)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:05.293408 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:05.359800 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '320e89a0a54d41d09ac59a93516adfe2', 'request_id': 'req-83ee04f5-9012-4826-b8a1-4b3ed6672b94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:05.366725 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '320e89a0a54d41d09ac59a93516adfe2', 'request_id': 'req-83ee04f5-9012-4826-b8a1-4b3ed6672b94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:05.376486 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '320e89a0a54d41d09ac59a93516adfe2', 'request_id': 'req-83ee04f5-9012-4826-b8a1-4b3ed6672b94'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:05.391418 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] The token cache is being invalidate because project 320e89a0a54d41d09ac59a93516adfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80416) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:05.391909 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:05.393052 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-83ee04f5-9012-4826-b8a1-4b3ed6672b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:05.395742 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1434/2827] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:05 2022] DELETE /identity/v3/projects/320e89a0a54d41d09ac59a93516adfe2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:05.400790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d14528-c39f-4387-ab9b-b0f8281b09b4 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.401332 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d14528-c39f-4387-ab9b-b0f8281b09b4 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.401452 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d14528-c39f-4387-ab9b-b0f8281b09b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.422160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-75d14528-c39f-4387-ab9b-b0f8281b09b4 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:05.423798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-75d14528-c39f-4387-ab9b-b0f8281b09b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:05.525857 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1394/2828] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:05.535086 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206d07-e2ac-4e67-88c9-75701bf465fb None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.535771 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206d07-e2ac-4e67-88c9-75701bf465fb None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.536250 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef206d07-e2ac-4e67-88c9-75701bf465fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.563587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ef206d07-e2ac-4e67-88c9-75701bf465fb None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:05.565425 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ef206d07-e2ac-4e67-88c9-75701bf465fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:05.576550 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1435/2829] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:05.581565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d14528-c39f-4387-ab9b-b0f8281b09b4 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:05.592535 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d14528-c39f-4387-ab9b-b0f8281b09b4 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:05.598919 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:05.599617 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.599900 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.600201 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.600962 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80415) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 21:22:05.601274 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:05.602922 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:05.620576 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1395/2830] 10.222.0.43 () {58 vars in 1152 bytes} [Thu Jun 16 21:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 21:22:05.624283 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef206d07-e2ac-4e67-88c9-75701bf465fb None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:05.640300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef206d07-e2ac-4e67-88c9-75701bf465fb None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:05.646579 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:05.647686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.648249 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.648765 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.649678 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:05.651722 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:05.681013 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1436/2831] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:22:05 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:05.685371 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:05.698058 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1cc2ca-7e2c-4873-b5fb-6ce2237ca884 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:05.708530 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:05.767930 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:05.768722 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.769012 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.769292 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.769991 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:05.771945 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:05.791887 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1396/2832] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:22:05 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:05.795932 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:05.807079 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a380d-4c46-402e-8885-11fc2bb7fb64 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:05.814021 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:05.815138 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.815605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.816061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.817864 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:05.820465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:05.835446 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1437/2833] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:22:05.839401 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:05.850711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cc55c-83a3-41c4-aa34-2da22ea4938a admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:05.855360 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f14ba9-0442-44db-8f1d-597d50dcc83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:05.856013 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14ba9-0442-44db-8f1d-597d50dcc83d admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.856344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14ba9-0442-44db-8f1d-597d50dcc83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.856624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14ba9-0442-44db-8f1d-597d50dcc83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.857343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f14ba9-0442-44db-8f1d-597d50dcc83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:05.858999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f14ba9-0442-44db-8f1d-597d50dcc83d admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:05.869229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1397/2834] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:22:05.873515 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:05.883668 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc36e9-0ced-48ad-a740-e8e4b46072c0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:05.888377 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:05.889261 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.889542 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.889816 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] PATH_INFO: `/v3/projects/323f9d29126c41c5bed05a1443164d9e/users/ee5e780ce9df4cacb967ec43e0b77377/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.905708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323f9d29126c41c5bed05a1443164d9e, user_id=ee5e780ce9df4cacb967ec43e0b77377, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:05.909260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:05.923433 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1438/2835] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:22:05 2022] PUT /identity/v3/projects/323f9d29126c41c5bed05a1443164d9e/users/ee5e780ce9df4cacb967ec43e0b77377/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:05.933671 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7098ed-e0aa-4dae-bbaf-94283b37ee41 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:05.933972 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7098ed-e0aa-4dae-bbaf-94283b37ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:05.934239 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7098ed-e0aa-4dae-bbaf-94283b37ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:05.962168 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-2f7098ed-e0aa-4dae-bbaf-94283b37ee41 None None] MFA Rules not processed for user `ee5e780ce9df4cacb967ec43e0b77377`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:05.963413 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2f7098ed-e0aa-4dae-bbaf-94283b37ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:06.033052 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1398/2836] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:06.037657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.051856 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:06.108012 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd55c2-2db3-4c1f-9639-1be40c188474 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.113378 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.113985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.114275 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.114554 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.115273 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.117216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.146873 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1439/2837] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:22:06 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:06.148017 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7098ed-e0aa-4dae-bbaf-94283b37ee41 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.158790 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7098ed-e0aa-4dae-bbaf-94283b37ee41 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.222685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.223359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.223672 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.223948 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.224751 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.226652 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.247184 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1399/2838] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:22:06 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:22:06.252078 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.263154 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5720b-ef7c-44cf-801a-c07ca00b2254 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.268147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.268869 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.269277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.269616 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.270327 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.272095 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.284913 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1440/2839] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:22:06.288961 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.300088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f8a58-e837-4083-a1e0-13fa75a546a0 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.304764 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f442628-0d63-40fd-ba3e-f96fd0318a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.305424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442628-0d63-40fd-ba3e-f96fd0318a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.305704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442628-0d63-40fd-ba3e-f96fd0318a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.305976 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f442628-0d63-40fd-ba3e-f96fd0318a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.306726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f442628-0d63-40fd-ba3e-f96fd0318a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.308349 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f442628-0d63-40fd-ba3e-f96fd0318a3f admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.310507 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:06.320087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1400/2840] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 21:22:06.324036 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.334315 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f2363-3473-49c1-9a12-bbe19b1c58a8 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.338967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.339851 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.340139 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.340466 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] PATH_INFO: `/v3/projects/3153ca80c064487cb3f6c32b2f741961/users/c825abfeeaf945b7b572fdf2da03bf18/roles/9aa8f94e3f1446a788810d3425df2ccf` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.356826 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3153ca80c064487cb3f6c32b2f741961, user_id=c825abfeeaf945b7b572fdf2da03bf18, role_id=9aa8f94e3f1446a788810d3425df2ccf)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.360333 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.376533 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1441/2841] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:22:06 2022] PUT /identity/v3/projects/3153ca80c064487cb3f6c32b2f741961/users/c825abfeeaf945b7b572fdf2da03bf18/roles/9aa8f94e3f1446a788810d3425df2ccf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:06.453054 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21ef3a-27d8-49cb-a23b-e08104ab80df None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.453564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21ef3a-27d8-49cb-a23b-e08104ab80df None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.453678 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21ef3a-27d8-49cb-a23b-e08104ab80df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.483341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-ce21ef3a-27d8-49cb-a23b-e08104ab80df None None] MFA Rules not processed for user `c825abfeeaf945b7b572fdf2da03bf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:06.484680 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-ce21ef3a-27d8-49cb-a23b-e08104ab80df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:06.568265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1401/2842] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:06.572714 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.668549 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889ae0-27e2-4b60-bb34-45ac8b84b6d6 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.674383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.675059 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.675392 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.675617 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.679601 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.681760 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.716587 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1442/2843] 10.222.0.43 () {60 vars in 1152 bytes} [Thu Jun 16 21:22:06 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 21:22:06.719543 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21ef3a-27d8-49cb-a23b-e08104ab80df None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.732382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21ef3a-27d8-49cb-a23b-e08104ab80df None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.798694 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.799382 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.799700 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.800287 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.801087 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.803015 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.825276 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1402/2844] 10.222.0.43 () {60 vars in 1143 bytes} [Thu Jun 16 21:22:06 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 21:22:06.829194 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.840067 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520626b6-d274-4372-84e8-350dabdbbfd0 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.845069 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.845799 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.846152 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.846494 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.847305 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.849022 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.860231 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1443/2845] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:22:06.864534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.876019 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab851179-e2ea-41ed-bcd9-354037ba53a8 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.880865 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:06.881685 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:06.881970 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:06.882247 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] PATH_INFO: `/v3/projects/5056d5dcd23e4e46b4c2228889c0a636/users/65ab8421f56843ae9c5673ba2d6cacf6/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:06.913037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5056d5dcd23e4e46b4c2228889c0a636, user_id=65ab8421f56843ae9c5673ba2d6cacf6, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:06.913037 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:06.928624 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1403/2846] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:22:06 2022] PUT /identity/v3/projects/5056d5dcd23e4e46b4c2228889c0a636/users/65ab8421f56843ae9c5673ba2d6cacf6/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:06.932459 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:06.944857 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce31a8f-7fa2-4b9c-be29-eeb3ea51f250 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:06.978348 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:07.005837 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee6440-a2cf-4f5e-831f-8abeeeba5952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:07.006514 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee6440-a2cf-4f5e-831f-8abeeeba5952 admin admin] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:07.006907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee6440-a2cf-4f5e-831f-8abeeeba5952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:07.007188 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee6440-a2cf-4f5e-831f-8abeeeba5952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:07.007912 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee6440-a2cf-4f5e-831f-8abeeeba5952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:07.009600 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee6440-a2cf-4f5e-831f-8abeeeba5952 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:07.020192 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1444/2847] 10.222.0.43 () {58 vars in 1121 bytes} [Thu Jun 16 21:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 21:22:07.024328 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:07.035792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75135b5-f36c-46cd-bc66-e7e0edfc8a00 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:07.040405 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:07.041378 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:07.041635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:07.041911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] PATH_INFO: `/v3/projects/5056d5dcd23e4e46b4c2228889c0a636/users/65ab8421f56843ae9c5673ba2d6cacf6/roles/b7564b3ff8064aa09459135574f0a043` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:07.043913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5056d5dcd23e4e46b4c2228889c0a636, user_id=65ab8421f56843ae9c5673ba2d6cacf6, role_id=b7564b3ff8064aa09459135574f0a043)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:07.047655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:07.058872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1404/2848] 10.222.0.43 () {60 vars in 1482 bytes} [Thu Jun 16 21:22:07 2022] PUT /identity/v3/projects/5056d5dcd23e4e46b4c2228889c0a636/users/65ab8421f56843ae9c5673ba2d6cacf6/roles/b7564b3ff8064aa09459135574f0a043 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:07.070655 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:07.070958 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:07.071407 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:07.100707 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] MFA Rules not processed for user `65ab8421f56843ae9c5673ba2d6cacf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:07.101959 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:07.184683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1445/2849] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:22:07.201352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:07.203326 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:07.265725 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:07.287077 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6a979-67ff-41dc-8931-77a5032b5ce1 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:07.292645 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:07.293137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:07.293424 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:07.293849 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:07.367853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:07.370026 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:07.389048 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1405/2850] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:09.957976 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:09.960213 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:09.974064 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3765cc-7ae8-449a-b45f-58b566302d4d None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:09.978258 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:09.979038 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:09.979497 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:09.979803 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:10.047622 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:10.049128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:10.058935 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1446/2851] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:10.627874 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:10.636792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada90c12-2ab4-4629-bd2d-107bf32356d6 service cinder] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:10.640549 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43b8df-c023-498d-a2a0-a196f7265910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:10.641187 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b8df-c023-498d-a2a0-a196f7265910 service cinder] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:10.641467 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b8df-c023-498d-a2a0-a196f7265910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:10.641746 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43b8df-c023-498d-a2a0-a196f7265910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:10.650799 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43b8df-c023-498d-a2a0-a196f7265910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:10.652255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43b8df-c023-498d-a2a0-a196f7265910 service cinder] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:10.661706 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1406/2852] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:12.045387 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:12.049099 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:12.129026 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=100 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:12.134829 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b62141-888c-4064-9434-f858ee764574 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:12.139570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:12.141422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:12.141422 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:12.141684 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] PATH_INFO: `/v3/users/07e28d544a0a48b3ad4a4caf902fb18f` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:12.142747 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e28d544a0a48b3ad4a4caf902fb18f)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:12.144728 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:12.191380 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e28d544a0a48b3ad4a4caf902fb18f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.192041 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e28d544a0a48b3ad4a4caf902fb18f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.192694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e28d544a0a48b3ad4a4caf902fb18f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.205274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e28d544a0a48b3ad4a4caf902fb18f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.212109 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e28d544a0a48b3ad4a4caf902fb18f'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.225081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1447/2853] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:12 2022] DELETE /identity/v3/users/07e28d544a0a48b3ad4a4caf902fb18f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:12.229625 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:12.230133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:12.230236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:12.247464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:12.249042 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:12.311066 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1407/2854] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:12.320978 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:12.322671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:12.379675 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb2924-c3b5-4238-8393-d0c157df7d85 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:12.383151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:12.383790 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:12.384071 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:12.384438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:12.393280 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:12.394694 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:12.403993 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1448/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:12.668834 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:12.670468 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:12.689196 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805513aa-f15d-436f-b39e-94ea15141601 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:12.693925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:12.694813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:12.695099 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:12.695377 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] PATH_INFO: `/v3/projects/51ef86872f0e4a59b5ed0a34b04eef82` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:12.696711 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ef86872f0e4a59b5ed0a34b04eef82)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:12.698581 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:12.747853 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ef86872f0e4a59b5ed0a34b04eef82', 'request_id': 'req-4f80270e-aaca-4f18-9688-b5668323bdd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.754973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ef86872f0e4a59b5ed0a34b04eef82', 'request_id': 'req-4f80270e-aaca-4f18-9688-b5668323bdd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.763057 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ef86872f0e4a59b5ed0a34b04eef82', 'request_id': 'req-4f80270e-aaca-4f18-9688-b5668323bdd4'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.773640 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] The token cache is being invalidate because project 51ef86872f0e4a59b5ed0a34b04eef82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:12.773925 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.774552 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-4f80270e-aaca-4f18-9688-b5668323bdd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:12.776093 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1408/2856] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:12 2022] DELETE /identity/v3/projects/51ef86872f0e4a59b5ed0a34b04eef82 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:14.532376 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:14.533845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:14.547177 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d35ee-3cc3-47ba-97aa-af17762f9ae8 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:14.602853 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:14.603743 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:14.604028 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:14.604471 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] PATH_INFO: `/v3/users/ee5e780ce9df4cacb967ec43e0b77377` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:14.605706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5e780ce9df4cacb967ec43e0b77377)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:14.607644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:14.629690 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:14.657113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5e780ce9df4cacb967ec43e0b77377'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:14.657777 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5e780ce9df4cacb967ec43e0b77377'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:14.658390 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5e780ce9df4cacb967ec43e0b77377'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:14.670019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5e780ce9df4cacb967ec43e0b77377'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:14.677858 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5e780ce9df4cacb967ec43e0b77377'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:14.691101 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1449/2857] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:14 2022] DELETE /identity/v3/users/ee5e780ce9df4cacb967ec43e0b77377 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:14.695604 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:14.696083 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:14.696236 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:14.703520 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:14.715798 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:14.717443 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:14.779140 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1409/2858] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:14.789269 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:14.790671 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:14.849340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184a1c9-4b81-43e7-b36f-edf1317890a7 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:14.852977 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:14.853620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:14.853905 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:14.854180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:14.864151 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:14.865619 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:14.875985 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1450/2859] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:15.174940 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:15.176592 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:15.189969 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f946c-346d-4b50-90a2-691c3624ff2e None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:15.195522 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:15.196606 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:15.196891 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:15.197167 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] PATH_INFO: `/v3/projects/323f9d29126c41c5bed05a1443164d9e` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:15.198425 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=323f9d29126c41c5bed05a1443164d9e)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:15.200353 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:15.272750 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323f9d29126c41c5bed05a1443164d9e', 'request_id': 'req-9cc6d463-f6fa-4217-b6cb-967e31072901'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.279673 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323f9d29126c41c5bed05a1443164d9e', 'request_id': 'req-9cc6d463-f6fa-4217-b6cb-967e31072901'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.288952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323f9d29126c41c5bed05a1443164d9e', 'request_id': 'req-9cc6d463-f6fa-4217-b6cb-967e31072901'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.303444 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] The token cache is being invalidate because project 323f9d29126c41c5bed05a1443164d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:15.304411 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.305231 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.307314 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1410/2860] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:15 2022] DELETE /identity/v3/projects/323f9d29126c41c5bed05a1443164d9e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:15.311125 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:15.323204 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457bcb6-8d70-4a87-a1a0-878264e2339b service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:15.385081 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:15.385979 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:15.386260 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:15.386532 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] PATH_INFO: `/v3/users/c825abfeeaf945b7b572fdf2da03bf18` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:15.387729 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c825abfeeaf945b7b572fdf2da03bf18)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:15.389761 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:15.431766 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:15.438831 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c825abfeeaf945b7b572fdf2da03bf18'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.440328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c825abfeeaf945b7b572fdf2da03bf18'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.441272 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c825abfeeaf945b7b572fdf2da03bf18'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.456642 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c825abfeeaf945b7b572fdf2da03bf18'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.464570 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c825abfeeaf945b7b572fdf2da03bf18'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.481197 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1451/2861] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:15 2022] DELETE /identity/v3/users/c825abfeeaf945b7b572fdf2da03bf18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:15.761754 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:15.763342 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:15.779171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6d463-f6fa-4217-b6cb-967e31072901 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:15.839469 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:15.840358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:15.840641 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:15.840911 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] PATH_INFO: `/v3/projects/3153ca80c064487cb3f6c32b2f741961` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:15.842095 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3153ca80c064487cb3f6c32b2f741961)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:15.844708 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:15.877313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:15.892518 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3153ca80c064487cb3f6c32b2f741961', 'request_id': 'req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.898534 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3153ca80c064487cb3f6c32b2f741961', 'request_id': 'req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.905206 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3153ca80c064487cb3f6c32b2f741961', 'request_id': 'req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.916079 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] The token cache is being invalidate because project 3153ca80c064487cb3f6c32b2f741961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:15.916388 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.917009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:15.918533 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1411/2862] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:15 2022] DELETE /identity/v3/projects/3153ca80c064487cb3f6c32b2f741961 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:15.922706 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:15.924141 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:15.936845 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961a07c-a7be-49c5-bdea-bb467a60f309 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:15.993029 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:15.993907 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:15.994190 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:15.994469 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] PATH_INFO: `/v3/users/65ab8421f56843ae9c5673ba2d6cacf6` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:15.995646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ab8421f56843ae9c5673ba2d6cacf6)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:15.997631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:16.044004 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ab8421f56843ae9c5673ba2d6cacf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.044683 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ab8421f56843ae9c5673ba2d6cacf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.045291 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ab8421f56843ae9c5673ba2d6cacf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.057813 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ab8421f56843ae9c5673ba2d6cacf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.065773 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-6c1b55ad-dd41-4f1a-97fd-dba8cb4768e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ab8421f56843ae9c5673ba2d6cacf6'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.078662 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1452/2863] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:15 2022] DELETE /identity/v3/users/65ab8421f56843ae9c5673ba2d6cacf6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:16.352053 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:16.353476 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:16.377907 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1dc26-bcff-48c4-9f56-d6f8fd37b019 admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:16.437914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:16.439009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:16.439344 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:16.439872 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] PATH_INFO: `/v3/projects/5056d5dcd23e4e46b4c2228889c0a636` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:16.441060 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5056d5dcd23e4e46b4c2228889c0a636)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:16.443133 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:16.491835 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5056d5dcd23e4e46b4c2228889c0a636', 'request_id': 'req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.497804 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5056d5dcd23e4e46b4c2228889c0a636', 'request_id': 'req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.505738 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5056d5dcd23e4e46b4c2228889c0a636', 'request_id': 'req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.516022 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] The token cache is being invalidate because project 5056d5dcd23e4e46b4c2228889c0a636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:16.516343 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.516974 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:16.518524 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1412/2864] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:16 2022] DELETE /identity/v3/projects/5056d5dcd23e4e46b4c2228889c0a636 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:21.333198 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff2c9-7cf1-4ae5-b141-a7c298830b2f None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:21.333672 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff2c9-7cf1-4ae5-b141-a7c298830b2f None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:21.333772 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ff2c9-7cf1-4ae5-b141-a7c298830b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:21.351708 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-451ff2c9-7cf1-4ae5-b141-a7c298830b2f None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:21.353048 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-451ff2c9-7cf1-4ae5-b141-a7c298830b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:21.387157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:21.412673 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1453/2865] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:22:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:21.424602 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:21.425985 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:21.476132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:21.497313 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b17c8ff-aab8-4537-a8aa-cd73fab6a1df admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:21.503293 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:21.503941 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:21.504262 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:21.504539 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:21.512656 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:21.514282 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:21.523107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1413/2866] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:22:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:22:22.034180 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310111-89e8-4fb0-9dc2-a6244a15df6d None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:22.034477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310111-89e8-4fb0-9dc2-a6244a15df6d None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:22.034782 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77310111-89e8-4fb0-9dc2-a6244a15df6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:22.054147 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-77310111-89e8-4fb0-9dc2-a6244a15df6d None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:22.055335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-77310111-89e8-4fb0-9dc2-a6244a15df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:22.062581 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1454/2867] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 16 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:22.074570 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:22.085509 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043cfcf-9c37-4403-adf7-2768f033f0be service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:22.090528 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:22.091162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:22.091446 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:22.091727 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:22.100664 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:22.102249 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:22.111370 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1414/2868] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:22:22.301750 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ed3d-9e61-448a-93d7-116e991be655 None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:22.302042 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ed3d-9e61-448a-93d7-116e991be655 None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:22.302318 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83ed3d-9e61-448a-93d7-116e991be655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:22.332157 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-ba83ed3d-9e61-448a-93d7-116e991be655 None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:22.333383 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-ba83ed3d-9e61-448a-93d7-116e991be655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:22.340596 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1455/2869] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Jun 16 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 21:22:22.352536 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:22.363721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919dd1c1-9766-476c-ae41-1d0b5f257cd5 service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:22.368786 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:22.369422 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:22.369703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:22.369979 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:22.379271 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:22.380896 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:22.389084 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1415/2870] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:22:22.704957 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] REQUEST_METHOD: `POST` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:22.705247 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:22.705525 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:22.723106 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.auth.core [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] MFA Rules not processed for user `804e3317fa4f460aa7078b94db562934`. Rule list: `[]` (Enabled: `True`). {{(pid=80416) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:22.724344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:22.731293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1456/2871] 10.222.0.43 () {58 vars in 967 bytes} [Thu Jun 16 21:22:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:22.743713 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:22.754913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a444c76-43ef-49bb-9bdf-249fd4a26b2c service swift] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:22.759914 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0525be-bff2-4b8c-8580-e8117d8c6112 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759ce183ee164679ba3d16860c088804', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:22.760583 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0525be-bff2-4b8c-8580-e8117d8c6112 service swift] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:22.760863 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0525be-bff2-4b8c-8580-e8117d8c6112 service swift] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:22.761141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0525be-bff2-4b8c-8580-e8117d8c6112 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:22.769909 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0525be-bff2-4b8c-8580-e8117d8c6112 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:22.771457 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0525be-bff2-4b8c-8580-e8117d8c6112 service swift] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:22.779582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1416/2872] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Jun 16 21:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 21:22:24.830605 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:24.832128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:24.896644 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b086a5-1108-4327-a0ce-804c2bc599ec None None] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:24.901637 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:24.902534 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:24.902819 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:24.904033 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] PATH_INFO: `/v3/users/9683d5b707014851a89959b5640fcac7` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:24.905344 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9683d5b707014851a89959b5640fcac7)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:24.907303 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:24.951861 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9683d5b707014851a89959b5640fcac7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:24.952557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9683d5b707014851a89959b5640fcac7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:24.953169 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9683d5b707014851a89959b5640fcac7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:24.964904 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9683d5b707014851a89959b5640fcac7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:24.972301 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9683d5b707014851a89959b5640fcac7'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:24.984342 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1457/2873] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:22:24 2022] DELETE /identity/v3/users/9683d5b707014851a89959b5640fcac7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:24.989739 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:24.990213 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:24.990352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:25.008035 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] MFA Rules not processed for user `80358824790f4a5498dad87c4c82e1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:22:25.009265 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:25.070852 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1417/2874] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:22:25.080470 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:25.081891 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:25.128726 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:25.142557 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961e9f-c630-45ca-ba58-1016d4c59e65 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:25.146399 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:25.147104 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:25.147341 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:25.147627 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:25.156648 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:25.158647 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:25.167981 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1458/2875] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:22:25.334653 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:22:25.336089 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:22:25.350973 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd5093-64c5-4247-8257-c114fbacca5b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:22:25.355564 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:22:25.356459 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:22:25.356740 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:22:25.357541 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] PATH_INFO: `/v3/projects/7f9f61ec956d45e88b7e5f16e9132a56` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:22:25.359008 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9f61ec956d45e88b7e5f16e9132a56)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:22:25.360901 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:22:25.407730 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9f61ec956d45e88b7e5f16e9132a56', 'request_id': 'req-9ff6067b-4bbe-4abe-99e8-6078efab64fb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:25.413661 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9f61ec956d45e88b7e5f16e9132a56', 'request_id': 'req-9ff6067b-4bbe-4abe-99e8-6078efab64fb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:25.420953 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9f61ec956d45e88b7e5f16e9132a56', 'request_id': 'req-9ff6067b-4bbe-4abe-99e8-6078efab64fb'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:25.431873 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] The token cache is being invalidate because project 7f9f61ec956d45e88b7e5f16e9132a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:22:25.432163 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:25.432811 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:22:25.434347 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1418/2876] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:22:25 2022] DELETE /identity/v3/projects/7f9f61ec956d45e88b7e5f16e9132a56 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:22:35.163897 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=7 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:22:35.428999 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:41.530972 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:23:41.532411 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:41.544143 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9f51e-211c-49d8-b71e-81e4f5af07ad service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:23:41.592307 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:23:41.592996 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:23:41.593288 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:23:41.593566 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:23:41.595417 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:41.667073 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:23:41.668520 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:23:41.679490 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1459/2877] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:23:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:23:42.855978 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:23:42.857437 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:42.870363 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6067b-4bbe-4abe-99e8-6078efab64fb admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:23:42.874200 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656f5dd-cda5-4d0c-9a61-b7f8d7c3d5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:23:42.874836 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656f5dd-cda5-4d0c-9a61-b7f8d7c3d5ec service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:23:42.875117 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656f5dd-cda5-4d0c-9a61-b7f8d7c3d5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:23:42.875419 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656f5dd-cda5-4d0c-9a61-b7f8d7c3d5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:23:42.877171 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-1656f5dd-cda5-4d0c-9a61-b7f8d7c3d5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:42.890220 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656f5dd-cda5-4d0c-9a61-b7f8d7c3d5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:23:42.891635 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656f5dd-cda5-4d0c-9a61-b7f8d7c3d5ec service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:23:42.902603 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1419/2878] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:23:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:23:44.081832 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:23:44.084049 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:44.105300 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08b14-0e75-45ac-8f3a-62856c48e4d4 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:23:44.117379 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:23:44.120775 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:23:44.121068 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:23:44.121350 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:23:44.125146 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:44.144704 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:23:44.146498 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:23:44.161625 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1460/2879] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:23:45.172229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:23:45.172703 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:23:45.172812 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:23:45.190792 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] MFA Rules not processed for user `236f49a4117f488ea8bf5c523fadadc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:23:45.191971 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:45.245160 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1420/2880] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:23:45.556506 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:23:45.565686 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dbd4d-1387-4031-83ab-48cbfb54157d service nova] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:23:45.569237 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:23:45.569868 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:23:45.570156 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:23:45.570438 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:23:45.572233 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:45.582187 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:23:45.583779 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:23:45.591705 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1461/2881] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:23:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:23:46.039582 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:23:46.041036 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:46.111255 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa4827-9b4f-4cb0-9235-7ced4b90cad9 None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:23:46.116389 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:23:46.117040 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:23:46.117329 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:23:46.117609 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:23:46.119392 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:46.132504 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:23:46.134092 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:23:46.145137 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1421/2882] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:23:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:23:47.840483 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:23:47.850808 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3990b1e-de69-42a1-891c-223b6198afb9 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:23:47.854559 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:23:47.855217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:23:47.855504 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:23:47.855781 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:23:47.857584 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:23:47.869043 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:23:47.870477 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:23:47.881027 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1462/2883] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:23:56.140104 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=63 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:23:57.875465 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=72 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:24:02.041145 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:24:02.055571 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0c85-e8fa-4c4b-8c4f-af409b75c432 service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:24:02.061183 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d468d-acd5-47f6-a50f-e40ee2a4c618 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:24:02.061854 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d468d-acd5-47f6-a50f-e40ee2a4c618 service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:24:02.062141 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d468d-acd5-47f6-a50f-e40ee2a4c618 service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:24:02.062421 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d468d-acd5-47f6-a50f-e40ee2a4c618 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:24:02.064305 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-db0d468d-acd5-47f6-a50f-e40ee2a4c618 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:24:02.078088 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d468d-acd5-47f6-a50f-e40ee2a4c618 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:24:02.079704 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d468d-acd5-47f6-a50f-e40ee2a4c618 service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:24:02.092547 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1422/2884] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:24:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:24:12.087393 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=6 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:25:41.013142 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:25:41.014548 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:25:41.102967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1de94b-4a3d-4baf-92e0-8b1c88a2c2b1 service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:25:41.106611 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6a283856448d9aca6f50a3d58742f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:25:41.107394 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:25:41.107685 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:25:41.107966 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:25:41.110424 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:25:41.134631 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:25:41.136065 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:25:41.145620 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1463/2885] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:25:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:25:48.999409 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] REQUEST_METHOD: `POST` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:25:48.999910 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:25:49.000014 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:25:49.017721 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.auth.core [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] MFA Rules not processed for user `236f49a4117f488ea8bf5c523fadadc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80415) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 21:25:49.018926 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:25:49.025692 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1423/2886] 10.222.0.43 () {58 vars in 957 bytes} [Thu Jun 16 21:25:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 21:25:49.339890 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:25:49.341443 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:25:49.376450 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b287d8-a37b-434d-82c6-f85480b3f926 service cinder] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:25:49.379956 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:25:49.380630 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:25:49.380908 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:25:49.381182 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:25:49.382963 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:25:49.394216 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:25:49.395646 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:25:49.404217 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1464/2887] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:25:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:25:59.011881 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=3 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:25:59.400113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=60 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:26:04.292586 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:26:04.294107 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:26:04.352599 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da3f9f-8381-4f76-b3d6-e17a56b0ff7b None None] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:26:04.358162 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1e4d798757a41cfad3454940c12bcab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:26:04.358813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:26:04.359094 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:26:04.359368 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:26:04.362433 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:26:04.375390 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:26:04.377561 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:26:04.388049 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1424/2888] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:26:12.950207 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:26:12.972482 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54a2a2-2241-46c3-aaae-6c2bae7e49be service neutron] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:26:12.977920 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:26:12.978563 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:26:12.978849 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:26:12.979128 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:26:12.980900 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:26:13.009824 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:26:13.011460 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:26:13.022661 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1465/2889] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:26:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:26:14.383562 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=21 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:26:23.017299 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=15 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:27:50.489464 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:27:50.499152 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f6324-99f9-40e4-a789-838b56872f1e service nova] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:27:50.502952 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9ea56567eeb4392b5f9e5c84f16f413', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:27:50.503587 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:27:50.503862 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:27:50.504130 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:27:50.505915 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:27:50.589352 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:27:50.590859 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:27:50.611009 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1425/2890] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:27:53.651852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:27:53.676475 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b6084-3623-447b-b0a7-dd07725ea479 service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:27:53.695983 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:27:53.697484 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:27:53.697768 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:27:53.698444 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:27:53.709238 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:27:53.736019 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:27:53.742007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:27:53.754171 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1466/2891] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:27:56.895619 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:27:56.907335 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcb620-a210-4cd2-a067-188b3d450afe service neutron] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:27:56.912843 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:27:56.913502 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] REQUEST_METHOD: `GET` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:27:56.913848 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:27:56.914132 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:27:56.915913 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:27:56.931281 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:27:56.932847 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:27:56.945341 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1426/2892] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:27:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:27:56.960364 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:27:56.961875 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:27:56.980759 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf589-23a7-4932-8b62-29db0fccbf12 service placement] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:27:56.985400 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:27:56.986293 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:27:56.987111 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:27:56.987537 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] PATH_INFO: `/v3/users/236f49a4117f488ea8bf5c523fadadc8` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:27:56.988876 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236f49a4117f488ea8bf5c523fadadc8)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:27:56.990852 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:27:57.044657 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236f49a4117f488ea8bf5c523fadadc8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.045328 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236f49a4117f488ea8bf5c523fadadc8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.045945 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236f49a4117f488ea8bf5c523fadadc8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.058325 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236f49a4117f488ea8bf5c523fadadc8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.065641 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236f49a4117f488ea8bf5c523fadadc8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.077776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1467/2893] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:27:56 2022] DELETE /identity/v3/users/236f49a4117f488ea8bf5c523fadadc8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:27:57.254150 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:27:57.265846 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3128e272-d2f3-4579-b185-2b1e4c9e8472 service placement] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:27:57.323391 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:27:57.324283 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:27:57.324566 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:27:57.324841 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] PATH_INFO: `/v3/projects/b568a213302f46fda9ab9467d36996c5` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:27:57.326021 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b568a213302f46fda9ab9467d36996c5)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:27:57.327928 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:27:57.374813 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b568a213302f46fda9ab9467d36996c5', 'request_id': 'req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.381070 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b568a213302f46fda9ab9467d36996c5', 'request_id': 'req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.382707 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:27:57.388264 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b568a213302f46fda9ab9467d36996c5', 'request_id': 'req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.399069 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] The token cache is being invalidate because project b568a213302f46fda9ab9467d36996c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:27:57.399358 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.399989 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.401565 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1427/2894] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:27:57 2022] DELETE /identity/v3/projects/b568a213302f46fda9ab9467d36996c5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:27:57.405495 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:27:57.406917 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:27:57.421286 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ea425-7a7b-4482-b6b8-4ecbc358e884 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:27:57.478881 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:27:57.479687 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:27:57.479967 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:27:57.480277 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] PATH_INFO: `/v3/users/bfd30db32e6d471e9dc9def41048b9a8` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:27:57.481496 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd30db32e6d471e9dc9def41048b9a8)` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:27:57.483405 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:27:57.531274 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd30db32e6d471e9dc9def41048b9a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.531915 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd30db32e6d471e9dc9def41048b9a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.532547 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd30db32e6d471e9dc9def41048b9a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.543007 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:27:57.545501 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd30db32e6d471e9dc9def41048b9a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.553335 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.notifications [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd30db32e6d471e9dc9def41048b9a8'} {{(pid=80416) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.566812 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1468/2895] 10.222.0.43 () {58 vars in 1223 bytes} [Thu Jun 16 21:27:57 2022] DELETE /identity/v3/users/bfd30db32e6d471e9dc9def41048b9a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:27:57.754119 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Authenticating user token {{(pid=80415) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:27:57.755744 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.fernet_utils [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80415) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:27:57.770655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0ef33-b5a7-46ec-a5f5-7ae4392be1fe admin admin] Validating token access rules against request {{(pid=80415) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:27:57.828330 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80358824790f4a5498dad87c4c82e1b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c0cca612cc8a4e54bb60862d1d2ad94b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80415) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:27:57.829193 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:27:57.829484 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:27:57.829763 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] PATH_INFO: `/v3/projects/8390c06c0a13496b83e3be3c8ba69184` {{(pid=80415) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:27:57.831557 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8390c06c0a13496b83e3be3c8ba69184)` {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:27:57.833513 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] RBAC: Authorization granted {{(pid=80415) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:27:57.879020 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8390c06c0a13496b83e3be3c8ba69184', 'request_id': 'req-b85ca99a-2187-4837-9269-64e36c2484ee'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.884955 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8390c06c0a13496b83e3be3c8ba69184', 'request_id': 'req-b85ca99a-2187-4837-9269-64e36c2484ee'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.891875 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8390c06c0a13496b83e3be3c8ba69184', 'request_id': 'req-b85ca99a-2187-4837-9269-64e36c2484ee'} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.902737 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] The token cache is being invalidate because project 8390c06c0a13496b83e3be3c8ba69184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80415) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 21:27:57.903359 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.903655 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG keystone.notifications [None req-b85ca99a-2187-4837-9269-64e36c2484ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80415) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 21:27:57.905229 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: [pid: 80415|app: 0|req: 1428/2896] 10.222.0.43 () {58 vars in 1232 bytes} [Thu Jun 16 21:27:57 2022] DELETE /identity/v3/projects/8390c06c0a13496b83e3be3c8ba69184 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 21:28:07.562311 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:28:07.899726 dv-cinder-819149-6-iscsi devstack@keystone.service[80415]: DEBUG dbcounter [-] [80415] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=55 {{(pid=80415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 21:31:21.911776 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Authenticating user token {{(pid=80416) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 21:31:21.913974 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:31:21.993865 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7992770-3f51-40c2-81f8-ce829e9fb060 admin admin] Validating token access rules against request {{(pid=80416) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 21:31:22.054091 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824d643-2ccc-4b36-abc8-380066154bb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f7cc31562ab4ef5a72fadb9b8c98f41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8da273c0fcb649d4bcbf8b2222cf12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80416) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 21:31:22.054774 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d643-2ccc-4b36-abc8-380066154bb5 service placement] REQUEST_METHOD: `GET` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 21:31:22.055061 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d643-2ccc-4b36-abc8-380066154bb5 service placement] SCRIPT_NAME: `/identity` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 21:31:22.055340 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d643-2ccc-4b36-abc8-380066154bb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80416) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 21:31:22.057145 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.fernet_utils [None req-8824d643-2ccc-4b36-abc8-380066154bb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80416) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 21:31:22.068409 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824d643-2ccc-4b36-abc8-380066154bb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 21:31:22.070113 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824d643-2ccc-4b36-abc8-380066154bb5 service placement] RBAC: Authorization granted {{(pid=80416) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 21:31:22.079794 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: [pid: 80416|app: 0|req: 1469/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Jun 16 21:31:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 21:31:32.075612 dv-cinder-819149-6-iscsi devstack@keystone.service[80416]: DEBUG dbcounter [-] [80416] Writing DB stats keystone:SELECT=58 {{(pid=80416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}